-- Logs begin at Thu 2021-09-16 15:45:52 UTC, end at Thu 2021-09-16 16:53:48 UTC. -- Sep 16 16:14:03.696339 dv-cinder-805887-15-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Sep 16 16:14:06.423087 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.common.config [-] Logging enabled! Sep 16 16:14:06.423715 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.0.0.0rc2.dev2 Sep 16 16:14:06.423883 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=93843) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 16 16:14:06.427805 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.common.config [-] Logging enabled! Sep 16 16:14:06.428065 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.0.0.0rc2.dev2 Sep 16 16:14:06.428379 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=93843) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 16 16:14:06.429336 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 16:14:06.429576 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 16:14:06.429937 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 16:14:06.430186 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 16:14:06.430418 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 16:14:06.430745 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.431052 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.431385 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.431621 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.431920 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.432215 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.432502 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.432796 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.433094 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.433383 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.433665 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.433952 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.434185 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.434467 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] config_source = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.434753 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.435046 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.435304 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] debug = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.435589 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.436013 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.436421 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.436708 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.437001 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.437287 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.437561 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.437841 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.438128 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.438458 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] host = dv-cinder-805887-15-iscsi {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.438738 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.439035 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.439350 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.439655 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.439922 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.440203 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.440491 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.440767 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_dir = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.441043 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.441324 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.441644 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.442033 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.442333 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.442560 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.442787 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.443078 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.443398 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.443681 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.443959 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.444237 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.444770 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.445047 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.445320 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.445611 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.445900 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.446188 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.446465 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.446742 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.447016 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.447311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.447604 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.447882 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.448158 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.448438 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.448729 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.449005 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.449281 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.449583 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.449874 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.450161 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.450448 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.450728 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.451013 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.451319 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.451597 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] use_journal = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.451874 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] use_json = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.452161 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.452436 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.452708 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.452983 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.453257 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.453532 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.453808 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.454098 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:06.454397 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.454694 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.455002 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.455310 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.455608 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.455891 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.456185 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.456466 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.456758 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.457049 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.457366 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.457646 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.457941 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.458223 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.458520 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.458827 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.459130 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.459450 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.459729 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.460007 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.460325 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.460565 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.460853 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.461133 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.461421 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.461712 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.461996 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.462286 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.462581 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.462873 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.463150 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.463458 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.463752 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.464032 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.464309 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.464587 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.464877 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.465156 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.465429 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.465710 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.465988 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.466261 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.466533 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.466811 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.467101 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.467406 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.467680 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.467951 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.468230 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.468502 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.468787 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.469067 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.469340 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.469614 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.469891 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.470166 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.470439 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.470716 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.470988 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.471297 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.471575 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.471849 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.472122 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.472395 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.472668 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.473467 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.473739 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.474017 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.474293 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.474573 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.474849 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.475125 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.475424 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.475716 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.476016 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.476297 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.476582 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.476865 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.477147 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.477428 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.477710 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.477991 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.478272 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.478548 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.478842 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.479127 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.479446 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.479736 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.480019 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.480321 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.480603 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.480890 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.481171 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.481452 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.481738 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.482024 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.482322 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.482617 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.482916 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.483238 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.483530 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.483812 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.484122 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.484402 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:06.484624 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 16:14:06.484870 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=93843) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Sep 16 16:14:06.837590 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=93843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 16 16:14:06.837803 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=93843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 16 16:14:06.838096 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=93843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 16 16:14:06.838429 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [-] Loading core plugin: ml2 Sep 16 16:14:07.231291 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.231604 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.231882 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.233199 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.233476 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.233745 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.270373 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.270651 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.270921 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.285617 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.285901 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.286173 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.314094 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.314377 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.314651 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.353232 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.353511 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.353781 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.585931 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.586532 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.586532 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.586695 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.587375 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.707744 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.708067 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.708352 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.708623 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.708890 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.709200 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.709461 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.709718 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.709973 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.710254 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.710511 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.710773 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.711029 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.711303 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.711565 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.711828 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.712089 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.712355 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.712624 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.712899 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.713154 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.713408 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.713690 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.714068 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.714325 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.714571 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.714972 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:07.715237 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:07.715481 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:07.715721 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:07.715960 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:07.716197 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:07.716562 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Sep 16 16:14:07.719641 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Sep 16 16:14:07.724282 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Sep 16 16:14:07.727929 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(700, 749)])]) Sep 16 16:14:07.729557 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Sep 16 16:14:07.730011 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Sep 16 16:14:07.730351 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Sep 16 16:14:07.730738 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Sep 16 16:14:07.733555 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Sep 16 16:14:07.733809 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Sep 16 16:14:07.734155 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Sep 16 16:14:07.739502 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Sep 16 16:14:07.761813 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Sep 16 16:14:07.762273 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.762573 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=93843) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Sep 16 16:14:07.762940 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.764345 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=93843) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Sep 16 16:14:07.764789 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Sep 16 16:14:07.765041 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Sep 16 16:14:07.768218 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.768508 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:07.832835 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Sep 16 16:14:07.833078 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Sep 16 16:14:07.833319 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Sep 16 16:14:07.833686 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Sep 16 16:14:07.856358 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_db.sqlalchemy.engines [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 16:14:08.389538 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing driver for type 'gre' Sep 16 16:14:08.390168 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] gre ID ranges: [(1, 1000)] Sep 16 16:14:08.439884 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing driver for type 'local' Sep 16 16:14:08.440269 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing driver for type 'vlan' Sep 16 16:14:08.453594 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] VlanTypeDriver initialization complete Sep 16 16:14:08.453996 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing driver for type 'vxlan' Sep 16 16:14:08.454510 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] vxlan ID ranges: [(1, 1000)] Sep 16 16:14:08.509810 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing extension driver 'port_security' Sep 16 16:14:08.510157 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.extensions.port_security [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] PortSecurityExtensionDriver initialization complete Sep 16 16:14:08.510483 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing mechanism driver 'openvswitch' Sep 16 16:14:08.510809 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing mechanism driver 'hyperv' Sep 16 16:14:08.517390 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.plugin [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=93843) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:08.518076 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.518448 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.518804 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.519351 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=93843) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 16 16:14:08.519818 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.520179 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.520530 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.520928 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=93843) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 16 16:14:08.521343 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.521697 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.522043 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.522436 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=93843) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 16 16:14:08.522842 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > security_group after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.523194 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > security_group after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.523558 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > security_group after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.524270 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=93843) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 16 16:14:08.524686 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.525039 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.525384 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.525781 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=93843) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 16 16:14:08.526187 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > address_group after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.526535 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > address_group after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.526873 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > address_group after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.527300 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=93843) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 16 16:14:08.527679 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] ML2 OVO RPC backend initialized. {{(pid=93843) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Sep 16 16:14:08.528389 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_interface after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.528747 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.529168 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.529519 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > networks before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.529872 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.530214 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > ports before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.530554 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.530898 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnets before_response 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.531282 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.531625 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.531960 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.532295 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.532631 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.532965 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.533300 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.533639 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.533972 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > subnet after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.534560 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.plugin [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Modular L2 Plugin initialization complete Sep 16 16:14:08.534890 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading services supported by the core plugin {{(pid=93843) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Sep 16 16:14:08.535763 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.plugins.ml2.managers [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Got port-security extension from driver 'port_security' Sep 16 16:14:08.536238 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.extensions.vlantransparent [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Disabled vlantransparent extension. Sep 16 16:14:08.536761 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=93843) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Sep 16 16:14:08.537082 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: router Sep 16 16:14:08.573466 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_interface before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.573863 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_create 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.574244 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router before_create 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.574619 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_interface before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.575000 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.575391 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_delete 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.575760 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > floatingip after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.576115 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > floatingip after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.576479 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_create 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.576832 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_update 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.577189 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_update 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.577544 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.577906 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_update 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.578581 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_update 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.578732 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.579025 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.579395 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: subnet after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.579740 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.580165 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > port precommit_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.580525 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_create 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.580881 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.581229 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.581590 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router after_update 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.581948 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_delete 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.582332 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_create 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.582699 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router_interface after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.583051 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_update 55549900 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.583444 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > agent after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.583803 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > agent after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.584154 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > network after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.585021 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Tracking information for resource: router configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:08.585353 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Tracking information for resource: floatingip configured {{(pid=93843) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 16 16:14:08.590288 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.db.l3_agentschedulers_db [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Sep 16 16:14:08.590876 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.591274 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port after_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.591636 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port after_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.591999 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: port after_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.592791 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router before_create 55550100 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.593164 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_delete 55550100 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.593533 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_create 55550100 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.593895 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > router precommit_update 55550100 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.599274 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.provider_configuration [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service providers = [] {{(pid=93843) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Sep 16 16:14:08.599643 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.db.servicetype_db [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=93843) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Sep 16 16:14:08.602619 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.service_base [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=93843) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 16 16:14:08.602975 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.service_base [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=93843) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 16 16:14:08.603354 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.service_base [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=93843) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 16 16:14:08.604258 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.services.service_base [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=93843) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 16 16:14:08.604631 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.services.service_base [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Default provider is not specified for service type L3_ROUTER_NAT Sep 16 16:14:08.605013 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.605338 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Sep 16 16:14:08.616834 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded METERING plugin. Description: METERING {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.617175 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: auto_allocate Sep 16 16:14:08.622900 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: network precommit_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.623307 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: network precommit_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.623840 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.624167 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: tag Sep 16 16:14:08.630678 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.631012 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: timestamp Sep 16 16:14:08.635022 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.635389 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: network_ip_availability Sep 16 16:14:08.640785 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.641167 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.641530 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.642248 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.642571 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: flavors Sep 16 16:14:08.647318 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.647655 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading Plugin: revisions Sep 16 16:14:08.651923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=93843) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 16 16:14:08.652318 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_concurrency.lockutils [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.814s {{(pid=93843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 16 16:14:08.653052 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=93843) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Sep 16 16:14:08.653393 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Initializing extension manager. Sep 16 16:14:08.653905 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: __init__.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.654248 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: __pycache__ {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.654586 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.654923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: address_group.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.655710 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.656279 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: address-group Sep 16 16:14:08.656605 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: address_scope.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.657510 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.658030 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: address-scope Sep 16 16:14:08.658358 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: admin_state_down_before_update.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.659322 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.659837 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: router-admin-state-down-before-update Sep 16 16:14:08.660685 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: agent.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.661409 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.661928 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: agent Sep 16 16:14:08.662255 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: agent_resources_synced.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.663180 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.663802 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: agent-resources-synced Sep 16 16:14:08.664136 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: allowedaddresspairs.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.665941 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.666464 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: allowed-address-pairs Sep 16 16:14:08.666795 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: auto_allocated_topology.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.667905 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.668418 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: auto-allocated-topology Sep 16 16:14:08.668749 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: availability_zone.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.668749 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.669950 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: availability_zone Sep 16 16:14:08.670275 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: availability_zone_filter.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.671193 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.671729 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: availability_zone_filter Sep 16 16:14:08.672047 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: data_plane_status.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.672955 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.673460 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension data-plane-status not supported by any of loaded plugins Sep 16 16:14:08.673783 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: default_subnetpools.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.674704 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.675242 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: default-subnetpools Sep 16 16:14:08.675560 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: dhcpagentscheduler.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.676962 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.677478 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: dhcp_agent_scheduler Sep 16 16:14:08.677807 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: dns.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.678754 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.679290 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension dns-integration not supported by any of loaded plugins Sep 16 16:14:08.679617 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: dns_domain_ports.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.680542 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.681049 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension dns-domain-ports not supported by any of loaded plugins Sep 16 16:14:08.681373 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.682302 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.682811 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Sep 16 16:14:08.683136 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: dvr.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.683833 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.684337 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: dvr Sep 16 16:14:08.684660 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: ecmp_routes.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.685578 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.686081 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension ecmp_routes not supported by any of loaded plugins Sep 16 16:14:08.686404 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: empty_string_filtering.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.687356 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.687867 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: empty-string-filtering Sep 16 16:14:08.688200 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.689111 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.689623 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Sep 16 16:14:08.689950 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.690858 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.691422 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Sep 16 16:14:08.691762 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: external_net.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.692677 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.693188 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: external-net Sep 16 16:14:08.693513 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: extra_dhcp_opt.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.694673 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.695180 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: extra_dhcp_opt Sep 16 16:14:08.695535 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: extraroute.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.696453 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.696957 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: extraroute Sep 16 16:14:08.697279 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: extraroute_atomic.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.698324 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.698834 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: extraroute-atomic Sep 16 16:14:08.699153 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: filter_validation.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.699853 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.700356 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: filter-validation Sep 16 16:14:08.700679 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: fip_pf_description.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.701592 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.702097 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Sep 16 16:14:08.702412 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: fip_port_details.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.703370 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.703877 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: fip-port-details Sep 16 16:14:08.704197 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: flavors.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.705437 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.705959 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: flavors Sep 16 16:14:08.706284 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.707998 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.708529 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Sep 16 16:14:08.708859 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: floatingip_pools.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.709569 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.710088 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: floatingip-pools Sep 16 16:14:08.710417 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: ip_allocation.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.711383 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.711899 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension ip_allocation not supported by any of loaded plugins Sep 16 16:14:08.712224 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: ip_substring_port_filtering.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.713155 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.713671 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: ip-substring-filtering Sep 16 16:14:08.713997 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l2_adjacency.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.718734 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.718734 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension l2_adjacency not supported by any of loaded plugins Sep 16 16:14:08.718734 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.718734 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.718734 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: router Sep 16 16:14:08.718734 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3_conntrack_helper.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.719963 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.720503 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension l3-conntrack-helper not supported by any of loaded plugins Sep 16 16:14:08.720836 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3_ext_gw_mode.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.721773 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.722292 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: ext-gw-mode Sep 16 16:14:08.722619 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3_ext_ha_mode.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.724119 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.724635 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: l3-ha Sep 16 16:14:08.724961 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3_flavors.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.725887 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.726398 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: l3-flavors Sep 16 16:14:08.726722 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.727678 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.728197 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: l3-port-ip-change-not-allowed Sep 16 16:14:08.728522 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: l3agentscheduler.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.729571 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.730088 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: l3_agent_scheduler Sep 16 16:14:08.730418 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: logging.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.731971 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.732500 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension logging not supported by any of loaded plugins Sep 16 16:14:08.732839 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: metering.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.733592 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.734170 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: metering Sep 16 16:14:08.734504 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.735630 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.736150 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: metering_source_and_destination_fields Sep 16 16:14:08.736482 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: multiprovidernet.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.737415 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.737927 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: multi-provider Sep 16 16:14:08.738256 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: netmtu.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.739753 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.740265 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: net-mtu Sep 16 16:14:08.740594 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: netmtu_writable.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.741518 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.742029 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: net-mtu-writable Sep 16 16:14:08.742359 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: network_availability_zone.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.743040 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.743590 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: network_availability_zone Sep 16 16:14:08.743917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: network_ip_availability.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.745048 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.745564 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: network-ip-availability Sep 16 16:14:08.745896 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: network_segment_range.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.746661 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.747172 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension network-segment-range not supported by any of loaded plugins Sep 16 16:14:08.747526 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: pagination.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.748505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.748838 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: pagination Sep 16 16:14:08.749169 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: port_device_profile.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.750099 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.750612 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: port-device-profile Sep 16 16:14:08.750935 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: port_mac_address_regenerate.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.751912 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.752421 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: port-mac-address-regenerate Sep 16 16:14:08.752742 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: port_numa_affinity_policy.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.753672 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.754231 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: port-numa-affinity-policy Sep 16 16:14:08.754555 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: port_resource_request.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.755633 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.756142 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension port-resource-request not supported by any of loaded plugins Sep 16 16:14:08.756467 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: portbindings.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.757400 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.757908 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: binding Sep 16 16:14:08.758229 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: portbindings_extended.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.759527 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.760084 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: binding-extended Sep 16 16:14:08.760372 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: portsecurity.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.761300 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.761816 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: port-security Sep 16 16:14:08.762145 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: project_id.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.763120 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.763476 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: project-id Sep 16 16:14:08.763803 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: providernet.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.764822 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.765343 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: provider Sep 16 16:14:08.765667 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.769239 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.769798 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos not supported by any of loaded plugins Sep 16 16:14:08.770137 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_bw_limit_direction.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.771419 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.771941 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Sep 16 16:14:08.772273 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.773196 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.773712 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Sep 16 16:14:08.774038 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_default.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.774955 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.775503 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-default not supported by any of loaded plugins Sep 16 16:14:08.775832 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_fip.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.776483 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.776988 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-fip not supported by any of loaded plugins Sep 16 16:14:08.777311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_gateway_ip.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.778239 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.778750 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-gateway-ip not supported by any of loaded plugins Sep 16 16:14:08.779084 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_port_network_policy.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.780019 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.780530 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-port-network-policy not supported by any of loaded plugins Sep 16 16:14:08.780855 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_pps_rule.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.782042 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.782560 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-pps not supported by any of loaded plugins Sep 16 16:14:08.782888 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_rule_type_details.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.783846 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.784358 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-rule-type-details not supported by any of loaded plugins Sep 16 16:14:08.784682 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: qos_rules_alias.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.786263 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.786779 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension qos-rules-alias not supported by any of loaded plugins Sep 16 16:14:08.787105 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: quotasv2.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.788044 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.788378 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: quotas Sep 16 16:14:08.788705 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: quotasv2_detail.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.792018 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.792363 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: quota_details Sep 16 16:14:08.792699 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: rbac.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.793761 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.794297 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: rbac-policies Sep 16 16:14:08.794632 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: rbac_address_group.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.795598 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.796116 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: rbac-address-group Sep 16 16:14:08.796443 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: rbac_address_scope.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.797370 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.797884 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: rbac-address-scope Sep 16 16:14:08.798211 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: rbac_security_groups.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.799128 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.799671 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: rbac-security-groups Sep 16 16:14:08.799998 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: rbac_subnetpool.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.801562 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.802080 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: rbac-subnetpool Sep 16 16:14:08.802406 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: revisionifmatch.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.803369 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.803887 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: revision-if-match Sep 16 16:14:08.804212 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: revisions.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.805326 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.805845 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: standard-attr-revisions Sep 16 16:14:08.806174 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: router_availability_zone.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.806855 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.807392 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: router_availability_zone Sep 16 16:14:08.807719 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: routerservicetype.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.808647 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.809155 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension router-service-type not supported by any of loaded plugins Sep 16 16:14:08.809478 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.810406 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.810920 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: security-groups-normalized-cidr Sep 16 16:14:08.811271 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: security_groups_port_filtering.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.812195 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.812705 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: port-security-groups-filtering Sep 16 16:14:08.813029 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: security_groups_remote_address_group.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.813953 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.814465 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: security-groups-remote-address-group Sep 16 16:14:08.814790 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: securitygroup.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.826240 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.826780 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: security-group Sep 16 16:14:08.827121 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: segment.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.827948 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.828468 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension segment not supported by any of loaded plugins Sep 16 16:14:08.828801 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.829761 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.830276 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Sep 16 16:14:08.830608 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: servicetype.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.831824 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.832383 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: service-type Sep 16 16:14:08.832718 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: sorting.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.833713 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.834051 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: sorting Sep 16 16:14:08.834377 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: standard_attr_segment.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.835347 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.835869 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension standard-attr-segment not supported by any of loaded plugins Sep 16 16:14:08.836197 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: standardattrdescription.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.836854 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.837369 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: standard-attr-description Sep 16 16:14:08.837694 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: stateful_security_group.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.838632 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.839150 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: stateful-security-group Sep 16 16:14:08.839503 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: stdattrs_common.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.840093 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Sep 16 16:14:08.840413 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.841354 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.841870 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Sep 16 16:14:08.842196 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: subnet_onboard.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.843299 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.843825 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: subnet_onboard Sep 16 16:14:08.844151 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: subnet_segmentid_writable.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.845085 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.845596 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Sep 16 16:14:08.845923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: subnet_service_types.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.846859 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.847407 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: subnet-service-types Sep 16 16:14:08.848254 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: subnetallocation.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.849354 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.849874 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: subnet_allocation Sep 16 16:14:08.850210 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.850881 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.851422 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: subnetpool-prefix-ops Sep 16 16:14:08.851749 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.852700 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.853212 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Sep 16 16:14:08.853537 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: tagging.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.854611 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.855133 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: standard-attr-tag Sep 16 16:14:08.855487 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: timestamp.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.856678 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.857195 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loaded extension: standard-attr-timestamp Sep 16 16:14:08.857525 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: trunk.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.858560 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.859081 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension trunk not supported by any of loaded plugins Sep 16 16:14:08.859445 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: trunk_details.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.860394 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.860911 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension trunk-details not supported by any of loaded plugins Sep 16 16:14:08.861242 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: uplink_status_propagation.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.862175 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.862690 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension uplink-status-propagation not supported by any of loaded plugins Sep 16 16:14:08.863018 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Loading extension file: vlantransparent.py {{(pid=93843) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 16 16:14:08.864271 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=93843) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 16 16:14:08.864785 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extension vlan-transparent not supported by any of loaded plugins Sep 16 16:14:08.867374 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:network Sep 16 16:14:08.867913 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:subnet Sep 16 16:14:08.868313 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:subnetpool Sep 16 16:14:08.868715 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:port Sep 16 16:14:08.869942 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.870409 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service FLAVORS assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.871037 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.871509 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.871855 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:router Sep 16 16:14:08.872288 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:floatingip Sep 16 16:14:08.872781 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service METERING assigned prefix: /metering {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.874206 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.874578 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.874934 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93843) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:14:08.875985 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of CountableResource for resource:rbac_policy Sep 16 16:14:08.876444 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:security_group Sep 16 16:14:08.876873 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:security_group_rule Sep 16 16:14:08.877464 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service CORE assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.877795 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:subnetpool Sep 16 16:14:08.878143 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] subnetpool is already registered Sep 16 16:14:08.878587 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service CORE assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.878947 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:subnetpool Sep 16 16:14:08.879309 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] subnetpool is already registered Sep 16 16:14:08.881585 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.882023 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service FLAVORS assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.882616 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.883041 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.883414 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:router Sep 16 16:14:08.883758 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] router is already registered Sep 16 16:14:08.884172 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:floatingip Sep 16 16:14:08.884512 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] floatingip is already registered Sep 16 16:14:08.884967 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service METERING assigned prefix: /metering {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.885637 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of CountableResource for resource:rbac_policy Sep 16 16:14:08.885965 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] rbac_policy is already registered Sep 16 16:14:08.886378 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:security_group Sep 16 16:14:08.886714 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] security_group is already registered Sep 16 16:14:08.887114 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:security_group_rule Sep 16 16:14:08.887475 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] security_group_rule is already registered Sep 16 16:14:08.888100 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service CORE assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.888430 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:subnetpool Sep 16 16:14:08.888765 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] subnetpool is already registered Sep 16 16:14:08.889182 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.v2.resource_helper [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Service CORE assigned prefix: {{(pid=93843) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 16 16:14:08.889513 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Creating instance of TrackedResource for resource:subnetpool Sep 16 16:14:08.889846 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING neutron.quota.resource_registry [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] subnetpool is already registered Sep 16 16:14:08.890323 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: extensions {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.891837 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: address-groups {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.893329 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: address-scopes {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.895200 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: agents {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.896390 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: auto-allocated-topology {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.897656 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: availability_zones {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.898879 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: dhcp-networks {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.900427 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: dhcp-agents {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.901895 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: routers {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.904136 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: flavors {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.905314 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: service_profiles {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.906531 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: next_providers {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.908034 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: service_profiles {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.909579 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: floatingip-pools {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.911464 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: routers {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.913589 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: floatingips {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.914887 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: l3-routers {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.916320 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: l3-agents {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.917738 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: metering-labels {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.919105 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: metering-label-rules {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.920403 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: network-ip-availabilities {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.921688 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: bindings {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.924207 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: quotas {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.925695 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: quotas {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.927145 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: rbac-policies {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.928381 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: security-groups {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.929696 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: security-group-rules {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.930967 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: service-providers {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.932214 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: subnetpools {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.933659 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: subnetpools {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.935117 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.936818 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.938670 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.940512 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.942349 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.944218 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.946206 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.948170 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.949936 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.951712 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron.api.extensions [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Extended resource: tags {{(pid=93843) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 16 16:14:08.958217 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING keystonemiddleware.auth_token [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 16:14:08.962912 dv-cinder-805887-15-iscsi neutron-server[93843]: WARNING keystonemiddleware.auth_token [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 16:14:08.971562 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_concurrency.lockutils [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Acquired lock "singleton_lock" {{(pid=93843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 16 16:14:08.972040 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_concurrency.lockutils [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Releasing lock "singleton_lock" {{(pid=93843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 16 16:14:08.972720 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Starting 2 workers Sep 16 16:14:08.978088 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Started child 93950 {{(pid=93843) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 16 16:14:08.982507 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Started child 93951 {{(pid=93843) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 16 16:14:08.983528 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:08.984160 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO neutron.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Neutron service started, listening on 0.0.0.0:9696 Sep 16 16:14:08.984757 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Notify callbacks [] for process, before_spawn {{(pid=93843) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:08.984983 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [-] (93950) wsgi starting up on http://0.0.0.0:9696 Sep 16 16:14:08.987329 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:08.987790 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Starting 1 workers Sep 16 16:14:08.988764 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [-] (93951) wsgi starting up on http://0.0.0.0:9696 Sep 16 16:14:08.992766 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Started child 93952 {{(pid=93843) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 16 16:14:08.993409 dv-cinder-805887-15-iscsi neutron-server[93843]: INFO oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Starting 1 workers Sep 16 16:14:08.996716 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] calling RpcWorker wait() {{(pid=93952) _wait /opt/stack/neutron/neutron/service.py:128}} Sep 16 16:14:08.997259 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] returning from RpcWorker wait() {{(pid=93952) _wait /opt/stack/neutron/neutron/service.py:135}} Sep 16 16:14:08.998339 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Started child 93953 {{(pid=93843) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 16 16:14:08.998519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:08.998980 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:08.999329 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG neutron_lib.callbacks.manager [None req-9635dfd4-c58e-49bc-bbea-d27687026c2a None None] Notify callbacks [] for process, after_spawn {{(pid=93843) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:09.001599 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=93843) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 16 16:14:09.001834 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 16:14:09.002335 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 16:14:09.002335 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 16:14:09.002808 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 16:14:09.002808 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 16:14:09.003526 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.003898 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:09.004612 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.004612 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.004612 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.004923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.005555 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.005849 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.006244 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.006584 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.006836 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.007013 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.007182 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.007526 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.007808 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.008243 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.008574 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.008852 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.009129 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.009325 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.009797 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config_source = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.009904 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.010246 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.010479 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] debug = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.010675 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.011366 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.011654 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.012076 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.012182 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.012490 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.012814 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.013158 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.013426 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.013741 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.014033 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.014285 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.014546 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.014769 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.015128 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.015453 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.015727 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.016230 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] host = dv-cinder-805887-15-iscsi {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.016709 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.016709 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.017104 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.017314 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.017624 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.017784 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.018095 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.018477 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.018837 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.019083 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.020139 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.020420 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.020641 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_dir = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.021059 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.021264 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_options = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.021406 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.021706 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.021979 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.022210 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.022358 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.022563 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.022915 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.023076 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.023376 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.023690 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.023850 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.024201 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.024355 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.024808 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.025157 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.025533 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.026021 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.026234 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.026427 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.026760 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.026961 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.027287 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.027470 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.027728 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.027991 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.028318 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.028707 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.028910 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.029153 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.029392 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.029835 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.030128 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.030366 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.030590 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.030924 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.031626 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.031626 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.031957 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.032080 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.032327 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.033439 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.033953 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.034129 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.034411 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.034608 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.034759 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_journal = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.034980 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_json = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.035162 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.036015 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.036307 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.036537 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.037124 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.037124 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.038100 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.038695 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.039882 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.040176 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.040528 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.040778 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.040904 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:09.042756 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.043024 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.043383 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.044053 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.044335 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.044604 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.044970 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.045403 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.045923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.046165 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.046449 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.046779 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.047051 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.048291 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.048291 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.048291 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.048291 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.048291 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.049024 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.049024 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.049024 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.049391 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.049594 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.049816 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.050087 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.050715 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.59/identity {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.050715 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.051005 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.051130 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.051395 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.051532 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.051756 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.051976 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.052731 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.052731 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.052973 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.053175 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.053302 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.053439 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.053699 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.054405 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.054405 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.054405 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.055396 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.055396 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.055396 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.055396 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.056496 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.056496 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.056496 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.056855 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.056855 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.057106 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.057293 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.057515 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.057751 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.058159 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.058310 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.058436 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.058744 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.058890 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.059074 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.060529 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.060529 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.060529 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.060529 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.060529 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.060529 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061258 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061258 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061258 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061258 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061740 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061740 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.061968 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.062181 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.062419 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.062593 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.062826 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.063139 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.063384 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.063603 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.063819 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.064057 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.064293 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.064565 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.064900 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.065154 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.065396 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.065665 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.065918 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.066156 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.066414 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.066672 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.066926 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.067174 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.067449 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.067709 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.067959 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.068201 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.068449 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.068693 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.068912 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.069136 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.069635 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.069877 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.070101 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.070366 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.070647 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.070917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.071169 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.071468 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.071748 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.071975 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.072250 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.072500 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.072768 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.073072 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.073343 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.073619 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.073855 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.074108 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.074350 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.074602 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.074865 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.075127 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.075400 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.075655 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.075933 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.076161 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.076381 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.076597 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.076848 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.077181 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.077432 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.077663 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.077897 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.078198 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.078466 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.078713 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.078975 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.079252 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.079510 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.079764 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.080023 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.59/identity {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.080237 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.080479 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.080707 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.080925 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.081157 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.081389 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.081635 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.081848 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.082601 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.082868 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.083103 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.083343 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.083576 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.083794 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.084013 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.084260 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.084476 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.084697 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.084938 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.085157 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.085375 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.085618 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.085851 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.086103 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.086346 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.086613 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.086878 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.087116 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.087386 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.087623 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.087843 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.088079 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.088326 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.088544 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.088758 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.088971 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.089209 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.089448 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.089654 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.089880 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.090130 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.090387 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.090632 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.090959 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.091589 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.091589 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.091886 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.092038 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.092833 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.092833 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.092833 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.093303 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.093303 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.093581 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.093719 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.093874 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.094115 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.094331 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.094562 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.094772 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.094945 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.095170 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.095512 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.095758 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.096001 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.096231 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.096477 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.096731 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.096981 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.097194 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.097405 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.097648 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.098917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.098917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.098917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.099400 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.099400 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.099676 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.099821 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.100654 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.100654 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.100654 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101044 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101044 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101337 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101337 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101608 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101746 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.101957 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.102188 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.102406 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.102619 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.102866 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.103076 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.103310 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.103533 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.103748 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.103986 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.104287 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.104600 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.104859 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.105144 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.105392 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.105640 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.105881 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.106227 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.106479 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.106725 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.106946 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.107166 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.107443 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.107717 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.108038 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.108337 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.108586 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.108848 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.109142 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.109423 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:700:749'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.109707 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.109937 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.110231 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.110539 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.110821 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.111080 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.111358 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.111612 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.111853 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.112069 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.112306 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.112521 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.112737 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.112994 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.113243 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.113526 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.113740 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.113968 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.114186 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.114418 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.114644 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.114866 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.115078 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.115262 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 16:14:09.115797 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=93843) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 16 16:14:09.115966 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 16:14:09.116119 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 16:14:09.116286 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 16:14:09.116456 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 16:14:09.116607 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 16:14:09.116814 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.116976 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.117137 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.117293 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.117451 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.117631 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.117798 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.117948 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.118108 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.118265 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.118429 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.118586 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.118742 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.118899 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.119058 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.119240 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.119444 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.119609 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.119771 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.119934 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] config_source = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.120093 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.120250 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.120408 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] debug = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.120565 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.120780 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.120950 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.121110 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.121263 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.121422 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.121574 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.121733 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.121890 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122048 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122205 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122362 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122519 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122679 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122834 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.122994 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.123149 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.123326 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] host = dv-cinder-805887-15-iscsi {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.123485 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.123642 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.123800 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.123957 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.124115 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.124278 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.124422 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.124581 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.124737 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.124893 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.125051 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.125209 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.125367 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_dir = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.125525 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.125685 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_options = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.125842 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126000 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126156 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126339 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126504 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126662 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126819 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.126978 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.127135 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.127312 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.127474 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.127637 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.127813 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.127945 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.128102 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.128259 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.128416 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.128574 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.128732 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.128909 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.129071 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.129230 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.129388 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.129546 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.129703 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.129860 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130017 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130175 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130337 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130494 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130651 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130809 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.130967 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.131125 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.131303 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.131462 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.131621 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.131777 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.131940 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.132099 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.132256 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.132414 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.132573 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.132729 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.132885 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133042 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_journal = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133199 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_json = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133357 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133514 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133672 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133830 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.133987 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.134143 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.134300 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.134443 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 16:14:09.134625 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.134786 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.134957 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.135118 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.135297 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.135460 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.135627 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.135787 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.135948 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.136108 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.136275 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.136436 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.136715 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.136883 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.137048 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.137212 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.137366 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.137522 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.137683 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.137879 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.138041 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.138202 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.138372 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.138531 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.138692 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.138851 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.139012 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.139188 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.139369 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.139532 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.59/identity {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.139692 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.139853 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140014 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140176 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140337 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140498 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140694 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140793 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.140951 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.141112 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.141273 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.141434 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.141595 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.141756 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.141917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.142077 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.142238 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.142399 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.142559 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.142720 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.142879 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.143041 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.143202 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.143380 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.143540 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.143711 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.143871 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.144032 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.144192 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.144354 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.145017 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.145200 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.145342 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.145501 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.145663 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.145822 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146000 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146161 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146321 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146480 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146640 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146801 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.146966 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.147144 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.147322 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.147458 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.147595 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.147737 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.147889 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148033 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148197 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148356 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148517 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148677 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148837 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.148997 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.149142 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.149304 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.149466 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.149635 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.149812 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.149972 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.150132 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.150292 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.150453 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.150612 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.150777 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.150935 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.151097 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.151276 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.151437 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.151598 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.151760 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.151921 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152085 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152237 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152385 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152523 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152684 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152829 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.152991 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.153151 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.153310 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.153470 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.153629 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.153789 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.153958 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.154117 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.154280 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.154440 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.154610 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.154781 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.154954 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.155124 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.155334 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.155526 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.155695 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.155918 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.156083 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.156243 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.156432 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.156572 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.156745 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.156923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.157084 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.157245 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.157407 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.157589 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.157753 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.157916 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158083 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158218 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158368 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158506 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158663 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158822 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.158983 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.159144 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.159328 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.59/identity {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.159488 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.159647 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.159794 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.159956 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.160113 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.160318 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.160979 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.161246 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.161420 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.161582 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.161743 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.161905 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.162065 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.162225 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.162414 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.162578 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.162739 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.162899 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.163059 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.163261 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.163429 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.163590 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.163767 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.163954 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.164120 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.164270 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.164434 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.164594 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.164754 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.164917 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.165078 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.165240 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.165403 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.165564 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.165726 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.165892 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.166052 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.166214 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.166376 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.166536 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.166697 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.166857 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.167016 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.167193 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.167377 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.167538 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.167698 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.167860 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168019 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168179 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168340 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168499 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168593 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:09.168680 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168808 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.168960 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.169123 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.169284 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.169444 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.169604 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.169763 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.169923 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.170082 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.170256 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.170417 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.170577 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.170737 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.170897 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.171062 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.171253 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.171415 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.171576 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.171735 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.171898 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.172086 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.172335 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.172479 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.172656 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.172830 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.173034 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.173196 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.173369 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.173530 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.173692 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.173902 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.174064 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.174226 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.174399 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.174560 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.174722 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.174882 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.175031 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.175193 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.175385 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.175546 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.175712 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.175898 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.176060 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.176221 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.176392 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.176555 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.176717 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.176887 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.177047 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.177207 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.177368 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.177542 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.177702 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.177865 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.178026 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.178186 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.178347 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.178508 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.178673 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.178845 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.179014 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.179177 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.179371 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.179541 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:700:749'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.181505 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182311 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182897 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182897 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182897 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.182897 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.183278 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 16:14:09.183278 dv-cinder-805887-15-iscsi neutron-server[93843]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 16:14:09.369658 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60842) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:09.378064 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [-] 10.222.0.59 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0062494 Sep 16 16:14:20.779127 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebd9c74a-a412-4583-88bb-324cbbd8aff0 None None] get_active_networks_info from dv-cinder-805887-15-iscsi {{(pid=93952) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Sep 16 16:14:20.874443 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebd9c74a-a412-4583-88bb-324cbbd8aff0 None None] No non-hosted networks {{(pid=93952) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Sep 16 16:14:20.890780 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.agentschedulers_db [None req-ebd9c74a-a412-4583-88bb-324cbbd8aff0 None None] DHCP Agent not found on host dv-cinder-805887-15-iscsi {{(pid=93952) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Sep 16 16:14:21.013028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e5116fda-ef4f-4d8a-b703-cb14067e3510 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-66590497'] for agent, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:23.432858 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-fccaf8cb-e09e-439f-8ab1-83fc6b7d703f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-66590497'] for agent, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:23.476919 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-20e55642-93f3-45ca-8660-efbf992b4632 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:23.688399 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-66590497'] for agent, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:23.689466 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.690102 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.691336 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.691905 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.692383 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.696518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.696518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.696757 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.706004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.707034 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.707523 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.707969 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:23.708477 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-805887-15-iscsi', {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:23.727762 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-805887-15-iscsi', 'version_map': {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:24.362670 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-66590497'] for agent, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:26.149479 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-66590497'] for agent, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:27.223763 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60934) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:27.725014 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING oslo_policy.policy [None req-12a41e29-7493-4a54-9541-654acb2e1c0f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:14:27.725660 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING oslo_policy.policy [None req-12a41e29-7493-4a54-9541-654acb2e1c0f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:14:27.945906 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [None req-12a41e29-7493-4a54-9541-654acb2e1c0f admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:14:27.947015 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-12a41e29-7493-4a54-9541-654acb2e1c0f admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.7222707 Sep 16 16:14:28.744573 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.db.l3_hamode_db [None req-986f48d9-459f-4f08-a6ec-edb232ff4ea9 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Sep 16 16:14:28.822803 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-986f48d9-459f-4f08-a6ec-edb232ff4ea9 None None] Routers set() bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:14:28.823197 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-986f48d9-459f-4f08-a6ec-edb232ff4ea9 None None] Router IDs set() for agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Sep 16 16:14:30.337981 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60948) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:30.642912 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] Request body: {'subnetpool': {'is_default': True, 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:14:30.734989 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.policy [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=93951) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 16 16:14:30.783087 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING oslo_policy.policy [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:14:30.783476 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING oslo_policy.policy [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:14:30.791798 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.quota [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] Loaded quota_driver: . Sep 16 16:14:30.879927 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8727678971804', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8727678971299', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8727678983880', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8727678981548', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8727678410913', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8727679000797', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-580483', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-66415517', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-380281', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-437295'] for rbac-policy, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:30.947612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:30.948781 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3b251bc5-67f0-4ab0-98b9-a3bcdfb22cb7 admin admin] 10.222.0.59 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6098306 Sep 16 16:14:33.535484 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60960) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:33.828882 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Request body: {'network': {'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'name': 'private', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:14:33.861863 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Made reservation on behalf of a3b205d563dd4c88b50ff9a301c6487c for: {'network': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:14:33.864730 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:33.881550 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.007809 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.011690 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.030923 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 748} {{(pid=93951) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:14:34.056824 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8727675478164', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.057397 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Unsubscribe: segment precommit_create {{(pid=93951) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 16 16:14:34.057886 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.segments_db [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Added segment 9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0 of type vlan for network a1c6f66a-6066-450e-82db-bd6b0e9cd7af Sep 16 16:14:34.073829 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4259901-32ef-45e7-9db6-322abcd93f1d,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:34.120446 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.120796 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.121130 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.121455 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.121774 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.122109 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.122429 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.122755 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.123083 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.123417 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.123735 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.124039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Tracked resource versions report: Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: pushed versions: Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: { 'AddressGroup': {'1.2'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'ConntrackHelper': {'1.0'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Log': {'1.0'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Network': {'1.1'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Port': {'1.7'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'PortForwarding': {'1.2'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'QosPolicy': {'1.9'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroup': {'1.4'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SubPort': {'1.0'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Subnet': {'1.1'}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Trunk': {'1.1'}} Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: consumer versions: Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'ConntrackHelper': '1.0', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Log': '1.0', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Network': '1.1', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Port': '1.7', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'PortForwarding': '1.2', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'QosPolicy': '1.9', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroup': '1.4', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroupRule': '1.2', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SubPort': '1.0', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Subnet': '1.1', Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Trunk': '1.1'}} Sep 16 16:14:34.125349 dv-cinder-805887-15-iscsi neutron-server[93951]: {{(pid=93951) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:14:34.177696 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.216422 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.217569 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:34.218186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:34.273247 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7365861 Sep 16 16:14:34.316978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc3de61-104a-4293-8892-86e3a5ec8e4e admin admin] Pushing event updated for resources: {'Network': ['ID=a1c6f66a-6066-450e-82db-bd6b0e9cd7af,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:34.331973 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:14:36.911018 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60974) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:37.302602 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ae1efed-bd5d-4084-b3a6-b00366124b35 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:37.303976 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5ae1efed-bd5d-4084-b3a6-b00366124b35 admin admin] 10.222.0.59 "GET /v2.0/networks/a1c6f66a-6066-450e-82db-bd6b0e9cd7af HTTP/1.1" status: 200 len: 825 time: 0.3919942 Sep 16 16:14:37.328516 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f064e4a2-f78a-48b9-bd0b-478c3635d6df admin admin] 10.222.0.59 "GET /v2.0/subnetpools/80a07767-6317-4f1d-b6b9-5eb5fa26b120 HTTP/1.1" status: 200 len: 734 time: 0.0184510 Sep 16 16:14:37.337979 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Request body: {'subnet': {'gateway_ip': '172.20.0.1', 'ip_version': 4, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'name': 'private-subnet', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:14:37.359109 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Made reservation on behalf of a3b205d563dd4c88b50ff9a301c6487c for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:14:37.361420 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Notify callbacks [] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:37.646094 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:37.716568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=1e7c6568-d326-409f-af54-52f2d923ff38,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:37.719053 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Checking segment: {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:14:37.719445 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Network hostable DHCP agents. Network: a1c6f66a-6066-450e-82db-bd6b0e9cd7af, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:14:37.741170 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:14:37.752108 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, a1c6f66a-6066-450e-82db-bd6b0e9cd7af) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:14:37.756951 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:37.757529 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:37.763246 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b35f8c96-d7c2-4c8a-9856-fbceecf8efe5 None None] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:14:37.772323 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-11d58750-f6e0-4282-b591-dc8e6ddaa9fc admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4375050 Sep 16 16:14:38.074607 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:14:38.075861 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:38.343363 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Allocated IP 172.20.0.2 (a1c6f66a-6066-450e-82db-bd6b0e9cd7af/1e7c6568-d326-409f-af54-52f2d923ff38/a4e8352f-e21c-41f0-ad1a-b9d82653f010) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:14:38.563456 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:38.571519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:38.644835 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:14:38.653320 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:14:38.663062 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Pushing event updated for resources: {'Port': ['ID=a4e8352f-e21c-41f0-ad1a-b9d82653f010,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:38.665217 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:14:38.674675 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.675032 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.675394 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.675723 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.676049 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.676374 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.676694 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.677014 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.677349 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.677667 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.677981 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.678295 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Tracked resource versions report: Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: pushed versions: Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: { 'AddressGroup': {'1.2'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'ConntrackHelper': {'1.0'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Log': {'1.0'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Network': {'1.1'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Port': {'1.7'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'PortForwarding': {'1.2'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'QosPolicy': {'1.9'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroup': {'1.4'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SubPort': {'1.0'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Subnet': {'1.1'}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Trunk': {'1.1'}} Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: consumer versions: Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'ConntrackHelper': '1.0', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Log': '1.0', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Network': '1.1', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Port': '1.7', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'PortForwarding': '1.2', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'QosPolicy': '1.9', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroup': '1.4', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroupRule': '1.2', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SubPort': '1.0', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Subnet': '1.1', Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Trunk': '1.1'}} Sep 16 16:14:38.679698 dv-cinder-805887-15-iscsi neutron-server[93952]: {{(pid=93952) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:14:38.754737 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Attempting to bind port a4e8352f-e21c-41f0-ad1a-b9d82653f010 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:14:38.755122 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Attempting to bind port a4e8352f-e21c-41f0-ad1a-b9d82653f010 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:14:38.755554 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Attempting to bind port a4e8352f-e21c-41f0-ad1a-b9d82653f010 on network a1c6f66a-6066-450e-82db-bd6b0e9cd7af {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:14:38.760321 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 14, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:14:38.760726 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Checking segment: {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:14:38.761184 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:38.761565 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Bound using segment: {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:14:38.762016 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Bound port: a4e8352f-e21c-41f0-ad1a-b9d82653f010, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:14:38.762416 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:38.822264 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] For port a4e8352f-e21c-41f0-ad1a-b9d82653f010, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:14:38.826465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] For port a4e8352f-e21c-41f0-ad1a-b9d82653f010, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=a4e8352f-e21c-41f0-ad1a-b9d82653f010,segment=NetworkSegment(9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0),segment_id=9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:14:38.831451 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:38.894065 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-212cf7ab-8402-49ea-a06c-0672f63b6372 None None] Pushing event updated for resources: {'Port': ['ID=a4e8352f-e21c-41f0-ad1a-b9d82653f010,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:40.192818 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60982) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:40.501612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [None req-69c9cce4-6bd7-4059-aa59-af1825a42457 admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:14:40.503197 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-69c9cce4-6bd7-4059-aa59-af1825a42457 admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3090992 Sep 16 16:14:42.918811 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 60990) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:43.233129 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [None req-dbae1432-85fc-4088-87cb-feaed1c09501 admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:14:43.247234 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-dbae1432-85fc-4088-87cb-feaed1c09501 admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3141975 Sep 16 16:14:45.873599 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 32768) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:46.172848 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:14:46.199828 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:46.201686 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:46.337277 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:46.341839 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:46.353704 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:46.359488 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-aa11bbc6-da83-4339-9fe5-028f6ba188c3 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4804821 Sep 16 16:14:47.163286 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device a4e8352f-e21c-41f0-ad1a-b9d82653f010 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:14:47.256709 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port a4e8352f-e21c-41f0-ad1a-b9d82653f010 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:47.257102 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:47.285200 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03d5c45a-5db6-44ee-b107-369dd446127b None None] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:14:47.387170 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-497cde43-e555-4b0a-8cd6-20e52329ab26 None None] Provisioning complete for port a4e8352f-e21c-41f0-ad1a-b9d82653f010 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:47.387487 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-497cde43-e555-4b0a-8cd6-20e52329ab26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:47.481213 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:47.548984 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port a4e8352f-e21c-41f0-ad1a-b9d82653f010, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=a4e8352f-e21c-41f0-ad1a-b9d82653f010,segment=NetworkSegment(9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0),segment_id=9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:14:47.557426 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:47.675255 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=a4e8352f-e21c-41f0-ad1a-b9d82653f010,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:47.863153 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-1bf6ece9-d867-4a66-9ab6-84095613d2f5 None None] Provisioning complete for port a4e8352f-e21c-41f0-ad1a-b9d82653f010 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:47.863552 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bf6ece9-d867-4a66-9ab6-84095613d2f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:48.763311 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 32782) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:49.072225 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [None req-886bde65-a8ca-4972-81ad-f70f16c7f03a admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:14:49.073219 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-886bde65-a8ca-4972-81ad-f70f16c7f03a admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3089840 Sep 16 16:14:49.147597 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device a4e8352f-e21c-41f0-ad1a-b9d82653f010 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:14:49.196977 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port a4e8352f-e21c-41f0-ad1a-b9d82653f010 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:49.197350 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:50.692335 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-7d8c677b-df56-44b4-9cee-3426b76175d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:51.469483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 32790) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:51.785336 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Request body: {'network': {'router:external': True, 'provider:physical_network': 'physnet1', 'name': 'public', 'provider:network_type': 'flat', 'is_default': True, 'admin_state_up': True}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:14:51.805218 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Made reservation on behalf of 9a27143d070a42d9b0cbc9452fdde048 for: {'network': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:14:51.807655 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:51.817531 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:51.903475 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:51.906991 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:51.921970 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Reserving flat network on physical network physnet1 {{(pid=93951) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Sep 16 16:14:51.940973 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a02dd3f-bbf7-4cfc-a523-4615fa0df843,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:51.944282 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:51.944623 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.segments_db [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Added segment 68cf5864-2803-4fc0-948e-ca8c09944282 of type flat for network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea Sep 16 16:14:51.989227 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:52.020825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:52.021744 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:52.022315 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:52.049954 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5794680 Sep 16 16:14:52.084326 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68e6671-ea5c-4893-a2cd-de8dd11d3511 admin admin] Pushing event updated for resources: {'Network': ['ID=905a8e92-0b4e-4cbe-baa3-87fc28c615ea,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:52.094921 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:14:53.414903 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ffa947a2-0eec-4977-8b5e-fa6f83cda78e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:53.677563 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:54.298036 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:54.426814 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 32798) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:54.717357 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a26c969-9083-4322-b88c-d6a18596dc3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:54.718683 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8a26c969-9083-4322-b88c-d6a18596dc3a admin admin] 10.222.0.59 "GET /v2.0/subnets/1e7c6568-d326-409f-af54-52f2d923ff38 HTTP/1.1" status: 200 len: 849 time: 0.2908983 Sep 16 16:14:54.843082 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-98af07c4-6924-4945-9db4-abcb5fc857ea admin admin] 10.222.0.59 "GET /v2.0/routers/b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f HTTP/1.1" status: 200 len: 704 time: 0.1181390 Sep 16 16:14:55.102617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:55.396659 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Allocated IP 172.20.0.1 (a1c6f66a-6066-450e-82db-bd6b0e9cd7af/1e7c6568-d326-409f-af54-52f2d923ff38/ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:14:55.591289 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:55.655092 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:55.731489 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Pushing event updated for resources: {'Port': ['ID=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:55.747978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:14:55.749533 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:14:55.751887 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:14:55.752395 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:55.962201 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:55.992767 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-87efeb5a-c3a7-475d-bf95-fd25271c9f0a None None] Provisioning complete for port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:55.993287 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-87efeb5a-c3a7-475d-bf95-fd25271c9f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:56.024924 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-87efeb5a-c3a7-475d-bf95-fd25271c9f0a None None] Port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:14:56.107194 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:56.172110 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:56.176739 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:56.177496 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:56.236270 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Pushing event updated for resources: {'Port': ['ID=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:56.298389 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:14:56.299723 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:14:56.443822 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-faf91d11-3353-42d8-b732-fc2d3bbb77a4 None None] Provisioning complete for port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:56.444267 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-faf91d11-3353-42d8-b732-fc2d3bbb77a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:56.460503 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93951) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:14:56.478270 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-faf91d11-3353-42d8-b732-fc2d3bbb77a4 None None] Port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:14:56.554667 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:14:56.560435 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3148754d-dcc2-4656-ab6b-e4ff419e3daa admin admin] 10.222.0.59 "PUT /v2.0/routers/b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7112014 Sep 16 16:14:56.566249 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Sync routers for ids ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:14:56.577490 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Routers {'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:14:56.578317 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:14:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:56.761535 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Set router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f gateway port host: None {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:14:57.184890 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:14:46Z', 'updated_at': '2021-09-16T16:14:55Z', 'revision_number': 2, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'gw_port_host': None, '_interfaces': [{'id': 'ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad', 'name': '', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'mac_address': 'fa:16:3e:48:38:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:14:55Z', 'updated_at': '2021-09-16T16:14:56Z', 'revision_number': 2, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'subnets': [{'id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:57.236971 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Checking router: b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:14:57.237349 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Updating router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:14:57.284270 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:57.787792 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:57.794450 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:57.965955 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Attempting to bind port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:14:57.966363 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Attempting to bind port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:14:57.967324 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Attempting to bind port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad on network a1c6f66a-6066-450e-82db-bd6b0e9cd7af {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:14:57.969422 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Pushing event updated for resources: {'Port': ['ID=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:57.980497 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.980864 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.981204 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.981534 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.981861 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.982185 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.982507 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.982826 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.983158 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.983504 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.983827 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.984161 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Tracked resource versions report: Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: pushed versions: Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: { 'AddressGroup': {'1.2'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'ConntrackHelper': {'1.0'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Log': {'1.0'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Network': {'1.1'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Port': {'1.7'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'PortForwarding': {'1.2'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'QosPolicy': {'1.9'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroup': {'1.4'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SubPort': {'1.0'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Subnet': {'1.1'}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Trunk': {'1.1'}} Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: consumer versions: Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'ConntrackHelper': '1.0', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Log': '1.0', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Network': '1.1', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Port': '1.7', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'PortForwarding': '1.2', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'QosPolicy': '1.9', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroup': '1.4', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroupRule': '1.2', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SubPort': '1.0', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Subnet': '1.1', Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Trunk': '1.1'}} Sep 16 16:14:57.985575 dv-cinder-805887-15-iscsi neutron-server[93953]: {{(pid=93953) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:14:57.989752 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 14, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:14:57.990178 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Checking segment: {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:14:57.990663 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:57.991049 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Bound using segment: {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:14:57.991563 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Bound port: ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 748, 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:14:57.991958 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:58.008493 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-b53b5f0c-9f02-474a-aa4d-f0363d32535d None None] Provisioning complete for port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:58.009016 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b53b5f0c-9f02-474a-aa4d-f0363d32535d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:58.041958 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-b53b5f0c-9f02-474a-aa4d-f0363d32535d None None] Port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:14:58.065639 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:14:58.069056 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] For port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:14:58.088163 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] For port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,segment=NetworkSegment(9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0),segment_id=9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:14:58.092302 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:58.152022 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b90eff-4490-411b-b891-7a8355eb43ad None None] Pushing event updated for resources: {'Port': ['ID=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,revision_number=4']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:58.156317 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Routers {'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:14:58.156924 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:14:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:58.249546 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] Set router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f gateway port host: None {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:14:58.361106 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-61257e8b-3914-43b4-9a99-ce2d1ed34150 None None] Provisioning complete for port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:14:58.361495 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-61257e8b-3914-43b4-9a99-ce2d1ed34150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:58.441233 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-61257e8b-3914-43b4-9a99-ce2d1ed34150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:58.459286 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:14:46Z', 'updated_at': '2021-09-16T16:14:55Z', 'revision_number': 2, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'gw_port_host': None, '_interfaces': [{'id': 'ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad', 'name': '', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'mac_address': 'fa:16:3e:48:38:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:14:55Z', 'updated_at': '2021-09-16T16:14:58Z', 'revision_number': 4, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'subnets': [{'id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:14:58.472195 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-61257e8b-3914-43b4-9a99-ce2d1ed34150 None None] For port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,segment=NetworkSegment(9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0),segment_id=9dec88cc-95a9-4f2a-b2a3-db07fd65aaa0)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:14:58.477594 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-61257e8b-3914-43b4-9a99-ce2d1ed34150 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:58.487404 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5642e2b4-d25e-4690-9fb0-28f97ad6922f None None] The sync data for ids ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'] in dv-cinder-805887-15-iscsi is: [{'id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:14:46Z', 'updated_at': '2021-09-16T16:14:55Z', 'revision_number': 2, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'gw_port_host': None, '_interfaces': [{'id': 'ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad', 'name': '', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'mac_address': 'fa:16:3e:48:38:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:14:55Z', 'updated_at': '2021-09-16T16:14:58Z', 'revision_number': 4, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'subnets': [{'id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:14:58.534607 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61257e8b-3914-43b4-9a99-ce2d1ed34150 None None] Pushing event updated for resources: {'Port': ['ID=ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:58.854225 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 32818) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:14:58.963706 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a24c0ff3-9553-4979-a496-619fd2957a78 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:58.965233 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a24c0ff3-9553-4979-a496-619fd2957a78 admin admin] 10.222.0.59 "GET /v2.0/networks/905a8e92-0b4e-4cbe-baa3-87fc28c615ea HTTP/1.1" status: 200 len: 842 time: 0.1100187 Sep 16 16:14:58.975518 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Request body: {'subnet': {'gateway_ip': '172.27.3.1', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'ip_version': 4, 'name': 'public-subnet', 'enable_dhcp': False, 'cidr': '172.27.3.0/24'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:14:58.997133 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Made reservation on behalf of 9a27143d070a42d9b0cbc9452fdde048 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:14:58.999840 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:59.338777 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.objects.ports [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=93951) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Sep 16 16:14:59.339127 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:59.403280 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c21130ac-3af0-46c6-9ecc-12b38826b0d5,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:14:59.412737 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:14:59.413092 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Network hostable DHCP agents. Network: 905a8e92-0b4e-4cbe-baa3-87fc28c615ea, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:14:59.430923 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:14:59.440036 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 905a8e92-0b4e-4cbe-baa3-87fc28c615ea) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:14:59.444683 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:14:59.445275 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:14:59.449765 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1558a988-3d41-460e-8fec-f18a53b11765 None None] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:14:59.460472 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3c415e98-c6a3-4ce8-9042-e99edd2ba7f0 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4882634 Sep 16 16:14:59.590674 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f19f1c00-48ad-405f-bdfc-5e4fe470f3a0 None None] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:15:01.760766 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 32836) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:15:01.905698 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING oslo_policy.policy [None req-0168f928-6445-43d0-993b-19879fbcc1d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:15:01.906201 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING oslo_policy.policy [None req-0168f928-6445-43d0-993b-19879fbcc1d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:15:02.206009 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.policy [None req-0168f928-6445-43d0-993b-19879fbcc1d0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=93950) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 16 16:15:02.251562 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING oslo_policy.policy [None req-0168f928-6445-43d0-993b-19879fbcc1d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:15:02.251934 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING oslo_policy.policy [None req-0168f928-6445-43d0-993b-19879fbcc1d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 16 16:15:02.496306 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0168f928-6445-43d0-993b-19879fbcc1d0 admin admin] 10.222.0.59 "GET /v2.0/routers/b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f HTTP/1.1" status: 200 len: 710 time: 0.7279105 Sep 16 16:15:02.673690 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c71d1fc-709e-4a58-a1b6-363ed22c68a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:15:02.675400 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4c71d1fc-709e-4a58-a1b6-363ed22c68a4 admin admin] 10.222.0.59 "GET /v2.0/networks/905a8e92-0b4e-4cbe-baa3-87fc28c615ea HTTP/1.1" status: 200 len: 886 time: 0.1784680 Sep 16 16:15:02.684974 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:15:02.939789 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:03.177733 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:03.256236 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:03.437362 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Allocated IP 172.27.3.93 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/568c1fc2-c9d2-4136-b43f-5d9745858496) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:15:03.558928 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:03.625392 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:03.647098 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:15:03.667052 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:15:03.740406 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:15:03.748884 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Pushing event updated for resources: {'Port': ['ID=568c1fc2-c9d2-4136-b43f-5d9745858496,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:15:03.787245 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.787594 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.787928 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.788254 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.788574 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.788896 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.789214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.789544 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.789875 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.790192 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.790499 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.790807 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Tracked resource versions report: Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: pushed versions: Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: { 'AddressGroup': {'1.2'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'ConntrackHelper': {'1.0'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Log': {'1.0'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Network': {'1.1'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Port': {'1.7'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'PortForwarding': {'1.2'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'QosPolicy': {'1.9'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroup': {'1.4'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SubPort': {'1.0'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Subnet': {'1.1'}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Trunk': {'1.1'}} Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: consumer versions: Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'ConntrackHelper': '1.0', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Log': '1.0', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Network': '1.1', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Port': '1.7', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'PortForwarding': '1.2', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'QosPolicy': '1.9', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroup': '1.4', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroupRule': '1.2', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SubPort': '1.0', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Subnet': '1.1', Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Trunk': '1.1'}} Sep 16 16:15:03.792197 dv-cinder-805887-15-iscsi neutron-server[93950]: {{(pid=93950) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:15:04.031702 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:04.259768 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-66710461', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-66589197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6651'] for router, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:04.264742 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-66710454', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-66710447', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-66589190'] for router, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:04.375791 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:15:04.480650 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:15:04.485282 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:04.486477 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-25b353b3-d920-4ee2-ae7b-879d37aae912 admin admin] 10.222.0.59 "PUT /v2.0/routers/b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f HTTP/1.1" status: 200 len: 889 time: 1.8049059 Sep 16 16:15:04.880854 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Sync routers for ids ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:15:04.892170 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Routers {'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:15:04.892881 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:14:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:15:05.102815 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Set router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:15:05.174272 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:15:05.398962 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:15:05.399258 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:05.584366 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.93'}], 'enable_snat': True}, 'gw_port_id': '568c1fc2-c9d2-4136-b43f-5d9745858496', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:14:46Z', 'updated_at': '2021-09-16T16:15:03Z', 'revision_number': 4, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'gw_port': {'id': '568c1fc2-c9d2-4136-b43f-5d9745858496', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:f7:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:15:03Z', 'updated_at': '2021-09-16T16:15:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad', 'name': '', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'mac_address': 'fa:16:3e:48:38:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:14:55Z', 'updated_at': '2021-09-16T16:14:58Z', 'revision_number': 5, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'subnets': [{'id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:15:05.634379 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Checking router: b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:15:05.634741 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Updating router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f port 568c1fc2-c9d2-4136-b43f-5d9745858496 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:15:05.679595 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:05.991515 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:05.996856 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:06.122772 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Attempting to bind port 568c1fc2-c9d2-4136-b43f-5d9745858496 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:15:06.123143 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Attempting to bind port 568c1fc2-c9d2-4136-b43f-5d9745858496 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:15:06.123530 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Attempting to bind port 568c1fc2-c9d2-4136-b43f-5d9745858496 on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:15:06.132143 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4376f79-fc53-4bd8-9e3d-e1b9cd826b67 None None] Pushing event updated for resources: {'Port': ['ID=568c1fc2-c9d2-4136-b43f-5d9745858496,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:15:06.134520 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 14, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:15:06.134893 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:15:06.135318 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:06.135702 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:15:06.136163 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Bound port: 568c1fc2-c9d2-4136-b43f-5d9745858496, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:15:06.136556 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:06.186556 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] For port 568c1fc2-c9d2-4136-b43f-5d9745858496, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:15:06.189965 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] For port 568c1fc2-c9d2-4136-b43f-5d9745858496, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=568c1fc2-c9d2-4136-b43f-5d9745858496,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:15:06.193751 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:06.250480 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4376f79-fc53-4bd8-9e3d-e1b9cd826b67 None None] Pushing event updated for resources: {'Port': ['ID=568c1fc2-c9d2-4136-b43f-5d9745858496,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:15:06.253894 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Routers {'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:15:06.254836 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:14:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:15:06.358319 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] Set router b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:15:06.562873 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.93'}], 'enable_snat': True}, 'gw_port_id': '568c1fc2-c9d2-4136-b43f-5d9745858496', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:14:46Z', 'updated_at': '2021-09-16T16:15:03Z', 'revision_number': 4, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'gw_port': {'id': '568c1fc2-c9d2-4136-b43f-5d9745858496', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:f7:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:15:03Z', 'updated_at': '2021-09-16T16:15:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad', 'name': '', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'mac_address': 'fa:16:3e:48:38:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:14:55Z', 'updated_at': '2021-09-16T16:14:58Z', 'revision_number': 5, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'subnets': [{'id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:15:06.589272 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4966e5-7256-412e-b583-383a44e96493 None None] The sync data for ids ['b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f'] in dv-cinder-805887-15-iscsi is: [{'id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'name': 'router1', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.93'}], 'enable_snat': True}, 'gw_port_id': '568c1fc2-c9d2-4136-b43f-5d9745858496', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:14:46Z', 'updated_at': '2021-09-16T16:15:03Z', 'revision_number': 4, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'gw_port': {'id': '568c1fc2-c9d2-4136-b43f-5d9745858496', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a9:f7:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:15:03Z', 'updated_at': '2021-09-16T16:15:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad', 'name': '', 'network_id': 'a1c6f66a-6066-450e-82db-bd6b0e9cd7af', 'tenant_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'mac_address': 'fa:16:3e:48:38:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b554c9ad-c0d6-4fc3-bbc2-a3d6d3d9a77f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:14:55Z', 'updated_at': '2021-09-16T16:14:58Z', 'revision_number': 5, 'project_id': 'a3b205d563dd4c88b50ff9a301c6487c', 'subnets': [{'id': '1e7c6568-d326-409f-af54-52f2d923ff38', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '80a07767-6317-4f1d-b6b9-5eb5fa26b120'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:15:06.896464 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 32860) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:15:07.011877 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-ddad0209-0483-4f5d-b92e-a9ec10ffa91e admin admin] 10.222.0.59 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1142843 Sep 16 16:15:07.191536 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 568c1fc2-c9d2-4136-b43f-5d9745858496 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:15:07.248866 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 568c1fc2-c9d2-4136-b43f-5d9745858496 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:15:07.249244 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:07.332975 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:07.352365 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 568c1fc2-c9d2-4136-b43f-5d9745858496, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=568c1fc2-c9d2-4136-b43f-5d9745858496,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:15:07.356558 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:07.402805 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=568c1fc2-c9d2-4136-b43f-5d9745858496,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:15:09.294570 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 568c1fc2-c9d2-4136-b43f-5d9745858496 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:15:09.354527 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 568c1fc2-c9d2-4136-b43f-5d9745858496 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:15:09.355019 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:20.701812 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e91a9f76-c12e-41e1-ace7-5c84f43575e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:23.416482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b4e1db92-0937-48a5-82ce-c17fde8081f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:23.682288 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:24.304482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:26.123623 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:35.065539 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:15:50.694906 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-852d3cd1-9dbb-4d10-b732-2b707e71a1aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:53.418858 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e2c346a0-7431-41ea-be44-2d324df4cbbc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:53.687124 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:54.358726 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:15:56.127203 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:12.064741 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:16:20.696939 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8592e54a-a4d9-493e-94a3-5f85cedb9fd9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:23.419169 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-423f8de8-beb6-442f-9503-f5549cfab613 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:23.688302 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:24.307194 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:26.127479 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:42.247715 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33422) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:42.307979 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.pecan_wsgi.hooks.translation [None req-b9c48258-e01f-4616-8ca8-76a00e6efd53 admin admin] GET failed (client error): The resource could not be found. Sep 16 16:16:42.309282 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-b9c48258-e01f-4616-8ca8-76a00e6efd53 admin admin] 10.222.0.59 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0606425 Sep 16 16:16:42.467374 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b3ce6a-1515-45f7-be97-66b17ac3ebe6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:42.468834 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e4b3ce6a-1515-45f7-be97-66b17ac3ebe6 admin admin] 10.222.0.59 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1550300 Sep 16 16:16:44.665330 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33432) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:44.755576 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-512a1186-02b1-4d20-9399-61b9873d44c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:44.756895 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-512a1186-02b1-4d20-9399-61b9873d44c2 admin admin] 10.222.0.59 "GET /v2.0/subnets/1e7c6568-d326-409f-af54-52f2d923ff38 HTTP/1.1" status: 200 len: 849 time: 0.0905912 Sep 16 16:16:44.767438 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:16:44.851951 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Notify callbacks [] for subnet, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:44.987607 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8727675731460'] for subnet, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:45.019863 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:45.020450 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:45.021732 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] 10.222.0.59 "PUT /v2.0/subnets/1e7c6568-d326-409f-af54-52f2d923ff38 HTTP/1.1" status: 200 len: 868 time: 0.2579815 Sep 16 16:16:45.039001 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5d1666d-cfd8-4d88-89ca-719091dcd109 None None] Network a1c6f66a-6066-450e-82db-bd6b0e9cd7af requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:16:45.044614 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1e7c6568-d326-409f-af54-52f2d923ff38,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:16:45.051277 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.051643 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.051987 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.052318 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.052651 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.052995 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.053334 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.053677 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.054194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.054544 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.054854 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.055180 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4a7427d-6fa9-4c85-927c-568b00ba30d1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:16:45.446012 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a60f2e88-9ceb-40e4-80ab-89d120101112 None None] Provisioning complete for port a4e8352f-e21c-41f0-ad1a-b9d82653f010 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:16:45.446390 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a60f2e88-9ceb-40e4-80ab-89d120101112 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:45.538234 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a60f2e88-9ceb-40e4-80ab-89d120101112 None None] Provisioning complete for port ec4d4678-0a43-4d17-aa4e-4a2c8f8710ad triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:16:45.538496 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a60f2e88-9ceb-40e4-80ab-89d120101112 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:47.226558 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33442) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:47.421620 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-289a1a3c-e9e1-43fe-a6df-a4d0fc325b2d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:47.422002 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-289a1a3c-e9e1-43fe-a6df-a4d0fc325b2d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:47.423525 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-289a1a3c-e9e1-43fe-a6df-a4d0fc325b2d admin admin] 10.222.0.59 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1960056 Sep 16 16:16:49.064033 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:16:49.664388 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33450) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:49.811408 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7a85bd9-997a-4936-94f3-6349360803c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:49.811877 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7a85bd9-997a-4936-94f3-6349360803c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:49.813579 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e7a85bd9-997a-4936-94f3-6349360803c0 admin admin] 10.222.0.59 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1482537 Sep 16 16:16:50.698465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b526d95d-28b2-4f2f-a4fc-72a5a7c676dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:52.010321 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33458) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:52.133234 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f24d72d5-0be8-422d-a4cf-c2f3709216e9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:52.134612 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f24d72d5-0be8-422d-a4cf-c2f3709216e9 admin admin] 10.222.0.59 "GET /v2.0/networks/905a8e92-0b4e-4cbe-baa3-87fc28c615ea HTTP/1.1" status: 200 len: 886 time: 0.1231723 Sep 16 16:16:53.419120 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-413a734b-edee-42cb-9175-10907ec72274 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:53.690839 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:54.301260 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33466) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:54.308803 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:54.431253 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcb19aeb-2da9-446e-88e6-01fce40d85ab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:54.432666 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-bcb19aeb-2da9-446e-88e6-01fce40d85ab admin admin] 10.222.0.59 "GET /v2.0/networks/a1c6f66a-6066-450e-82db-bd6b0e9cd7af HTTP/1.1" status: 200 len: 869 time: 0.1304615 Sep 16 16:16:56.133108 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:16:56.628084 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33474) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:56.750649 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6966b491-09cf-4717-bba3-b4dba384efb1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:56.751113 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6966b491-09cf-4717-bba3-b4dba384efb1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:56.752654 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-6966b491-09cf-4717-bba3-b4dba384efb1 admin admin] 10.222.0.59 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1236265 Sep 16 16:16:58.941298 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33482) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:16:59.064698 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d42dca7-7e2a-426f-8922-249dd79c9abe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:59.065412 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d42dca7-7e2a-426f-8922-249dd79c9abe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:16:59.066932 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1d42dca7-7e2a-426f-8922-249dd79c9abe admin admin] 10.222.0.59 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1247091 Sep 16 16:17:01.257866 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33490) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:17:01.361894 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fcda5ae-6bf5-4172-8b44-70bbf37b4792 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:17:01.363264 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-6fcda5ae-6bf5-4172-8b44-70bbf37b4792 admin admin] 10.222.0.59 "GET /v2.0/subnets/1e7c6568-d326-409f-af54-52f2d923ff38 HTTP/1.1" status: 200 len: 868 time: 0.1044309 Sep 16 16:17:03.552202 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33498) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:17:03.640493 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-066993c7-70d1-417b-b955-47dbe9f18c77 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:17:03.641814 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-066993c7-70d1-417b-b955-47dbe9f18c77 admin admin] 10.222.0.59 "GET /v2.0/subnets/c21130ac-3af0-46c6-9ecc-12b38826b0d5 HTTP/1.1" status: 200 len: 816 time: 0.0886502 Sep 16 16:17:20.701566 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-89b1a92a-fe7a-4c0c-93d4-773575d8907f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:23.419335 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-66db68ac-fa0a-487b-a97b-2856180bfcad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:23.691621 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:24.311399 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:26.063010 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:17:26.135898 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:27.255612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33552) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:17:27.301122 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [None req-03970d41-38e5-4532-945a-44498df94053 admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:17:27.302138 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-03970d41-38e5-4532-945a-44498df94053 admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0456016 Sep 16 16:17:29.577345 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33560) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:17:29.638641 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.pecan_wsgi.hooks.translation [None req-28e8cee0-6a15-496d-80ab-3e5bb95b9c8f admin admin] GET failed (client error): The resource could not be found. Sep 16 16:17:29.639958 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-28e8cee0-6a15-496d-80ab-3e5bb95b9c8f admin admin] 10.222.0.59 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0616946 Sep 16 16:17:29.779023 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a3fc4c1-f198-4a36-a591-ed582ffdb80b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:17:29.780444 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-4a3fc4c1-f198-4a36-a591-ed582ffdb80b admin admin] 10.222.0.59 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1358855 Sep 16 16:17:31.997789 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33568) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:17:32.044334 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:17:32.045544 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.quota [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Loaded quota_driver: . Sep 16 16:17:32.080741 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Made reservation on behalf of 9a27143d070a42d9b0cbc9452fdde048 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:17:32.083276 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:32.126369 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING neutron.services.revisions.revision_plugin [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Could not find related network for resource to bump revision. Sep 16 16:17:32.142009 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 719} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:17:32.155007 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8727675478164', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:32.155599 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Unsubscribe: segment precommit_create {{(pid=93950) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 16 16:17:32.156062 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Added segment 0841e726-8f7e-455b-8c2a-e02eb1bccc87 of type vlan for network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 Sep 16 16:17:32.206808 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:32.240238 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:32.241169 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:17:32.241762 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:32.305466 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3066189 Sep 16 16:17:32.339774 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Pushing event updated for resources: {'Network': ['ID=2484feaf-90a7-4e98-9b4b-a202ddaf5746,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:17:32.346948 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.347343 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.347692 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.348032 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.348365 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.348711 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.349045 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.349385 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.349734 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.350061 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.350381 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.350706 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28b5f60-5fd4-4707-9c4a-78dc97286bd4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:32.362394 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:17:34.515442 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33576) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:17:34.574411 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.pecan_wsgi.hooks.translation [None req-dddbd149-2dca-4cdb-bd3a-f0de208a0f08 admin admin] GET failed (client error): The resource could not be found. Sep 16 16:17:34.575742 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-dddbd149-2dca-4cdb-bd3a-f0de208a0f08 admin admin] 10.222.0.59 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0593369 Sep 16 16:17:34.643520 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65a5afb1-763d-4616-bb84-8766d32856d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:17:34.644962 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-65a5afb1-763d-4616-bb84-8766d32856d0 admin admin] 10.222.0.59 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0647438 Sep 16 16:17:34.654766 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746', 'name': 'shared-subnet', 'ip_version': 4, 'description': 'shared-subnet'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:17:34.677184 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Made reservation on behalf of 9a27143d070a42d9b0cbc9452fdde048 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:17:34.679391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Notify callbacks [] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:34.926113 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:34.982706 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Pushing event updated for resources: {'Subnet': ['ID=c2a91c97-52f1-46d7-9554-fa2169194eda,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:17:34.991411 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Checking segment: {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:17:34.991619 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Network hostable DHCP agents. Network: 2484feaf-90a7-4e98-9b4b-a202ddaf5746, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:17:35.011668 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:17:35.021668 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 2484feaf-90a7-4e98-9b4b-a202ddaf5746) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:17:35.026464 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:17:35.027076 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.031867 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64988a9b-fe69-46b9-ace4-e79c37979d76 None None] Network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:17:35.043311 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3d580c9c-2544-4135-8d3d-4ce2f5b67cdf admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3917398 Sep 16 16:17:35.180862 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-2484feaf-90a7-4e98-9b4b-a202ddaf5746', 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746', 'tenant_id': '9a27143d070a42d9b0cbc9452fdde048', 'fixed_ips': [{'subnet_id': 'c2a91c97-52f1-46d7-9554-fa2169194eda'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:17:35.181807 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.325886 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Allocated IP 192.168.233.2 (2484feaf-90a7-4e98-9b4b-a202ddaf5746/c2a91c97-52f1-46d7-9554-fa2169194eda/3865a9c8-357a-4bd1-b5b6-e78c913d7c6f) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:17:35.470384 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.477463 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.518804 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:17:35.520160 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:17:35.524482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:17:35.538261 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Pushing event updated for resources: {'Port': ['ID=3865a9c8-357a-4bd1-b5b6-e78c913d7c6f,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:17:35.560353 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.560724 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.561074 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.561420 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.561751 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.562087 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.562417 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.562747 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.563096 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.563473 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.563802 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.564129 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:17:35.593767 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Attempting to bind port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:17:35.594136 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Attempting to bind port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:17:35.594495 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Attempting to bind port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f on network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:17:35.599624 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 17, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:17:35.599995 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Checking segment: {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:17:35.600398 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.600789 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Bound using segment: {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:17:35.601248 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Bound port: 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:17:35.601646 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.663439 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] For port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:17:35.666457 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] For port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=3865a9c8-357a-4bd1-b5b6-e78c913d7c6f,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:17:35.671113 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:35.727865 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cfdffe-b7ce-40a8-b756-7c9edfb309f4 None None] Pushing event updated for resources: {'Port': ['ID=3865a9c8-357a-4bd1-b5b6-e78c913d7c6f,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:17:36.506523 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0009377d-3cf1-4591-bf70-a8a0a75e3e47 None None] Network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:17:36.626409 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-0086fb2a-eaf1-474d-b0a9-d9cc14bc46a5 None None] Provisioning complete for port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:17:36.626702 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0086fb2a-eaf1-474d-b0a9-d9cc14bc46a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:36.737391 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0086fb2a-eaf1-474d-b0a9-d9cc14bc46a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:36.772754 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-0086fb2a-eaf1-474d-b0a9-d9cc14bc46a5 None None] For port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=3865a9c8-357a-4bd1-b5b6-e78c913d7c6f,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:17:36.778745 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0086fb2a-eaf1-474d-b0a9-d9cc14bc46a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:36.832885 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0086fb2a-eaf1-474d-b0a9-d9cc14bc46a5 None None] Pushing event updated for resources: {'Port': ['ID=3865a9c8-357a-4bd1-b5b6-e78c913d7c6f,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:17:36.902791 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-f3ffc478-64f1-4f4f-838c-2e58054de2f1 None None] Provisioning complete for port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:17:36.903090 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f3ffc478-64f1-4f4f-838c-2e58054de2f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:37.413388 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:17:37.462476 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 3865a9c8-357a-4bd1-b5b6-e78c913d7c6f triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:17:37.462765 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:50.701706 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1e267f61-65fc-4a50-ad01-fb6249599637 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:53.421279 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1505a1a9-cd2f-4851-9d42-d652d3f8f4f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:53.692864 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:54.312971 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:17:56.138502 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:03.061213 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:18:20.703250 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1d94808f-50b6-401d-8e8d-0b09eeadfa40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:23.421052 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f0f58db9-ba35-439d-9127-b5975f851297 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:23.695733 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:24.316569 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:26.140694 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:40.059599 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:18:42.937731 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33628) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:18:42.944582 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [None req-048f1927-03c3-4a7d-aba5-a145dd02a4a9 tempest-verify_tempest_config-883344583 tempest-verify_tempest_config-883344583-project] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93950) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:18:42.945552 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-048f1927-03c3-4a7d-aba5-a145dd02a4a9 tempest-verify_tempest_config-883344583 tempest-verify_tempest_config-883344583-project] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0068610 Sep 16 16:18:43.228647 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33646) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:18:43.331354 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.419169 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.422810 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.469234 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=1e7355e888074198ac114c09f292d5d5&name=default HTTP/1.1" status: 200 len: 2975 time: 0.2395358 Sep 16 16:18:43.470041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0725ddb6-a17d-48ff-b14f-3c2163442c4d,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:18:43.471969 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33652) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:18:43.476592 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.476957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.477297 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.477628 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.477976 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.478314 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.478643 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.478965 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.479322 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.479648 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.479984 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.480301 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f7fe2cb-e24b-446d-91da-5dc9cf736457 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.547292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.567453 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.655418 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.657872 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:43.659027 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0725ddb6-a17d-48ff-b14f-3c2163442c4d HTTP/1.1" status: 204 len: 168 time: 0.1861107 Sep 16 16:18:43.666611 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0725ddb6-a17d-48ff-b14f-3c2163442c4d,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:18:43.673104 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.673471 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.673820 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.674157 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.674493 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.674839 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.675177 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.675546 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.675897 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.676227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.676551 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:43.676874 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9933a8ca-581b-4aa6-8d02-2b1bfdb4cd0f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:18:50.705546 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-80239231-8680-4c4d-bb01-e9cb357b2c37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:53.423475 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e8fc89a4-1d92-4d0f-827f-72a14a867fa1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:53.697830 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:54.321211 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:18:56.143602 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:17.058340 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:19:20.706621 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5d9d0357-133e-4f06-87c3-20b20bf4c59f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:23.423501 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-7163f5ea-91d7-4ff9-9189-1d7c27eeb75f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:23.696306 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:24.328492 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:26.145482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:50.706742 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4513effc-c1c9-48e9-adb0-490d8624be21 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:53.426572 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-316dcdc2-42b3-4b81-bcf9-cce1e05767dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:53.700738 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:54.057567 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 5 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:19:54.326234 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:19:56.150240 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:15.121417 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-66590497'] for agent, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:20.706725 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a25c307f-68c5-4c06-9704-b97e69c2bac3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:23.427022 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b54c2fdf-8483-4764-b652-be3cb0f43aa8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:23.701548 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:24.330005 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:26.153090 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:30.156484 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33726) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:20:30.258723 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-22edf6e3-c00f-4fa5-85c1-07982a48c4e9 admin admin] 10.222.0.59 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.1011701 Sep 16 16:20:31.056477 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:20:32.453489 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33736) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:20:32.506793 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e74d2b78-7614-4788-b180-938c877eb39f admin admin] 10.222.0.59 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.0522058 Sep 16 16:20:45.082406 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:50.706254 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b2b9ed93-1a2c-4690-afef-a063db4a197e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:53.431596 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-dc08fea9-53f0-4535-8436-977193480f7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:53.702181 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:54.332760 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:20:56.156105 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:08.054928 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:21:15.075954 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:20.707114 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-459c934c-a2ca-45c2-8dd8-b39ee298ec16 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:23.440853 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f519d3d8-51f7-4ba1-a3ee-f17d3592f729 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:23.704440 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:24.337804 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:26.163478 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:45.053192 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:21:45.172671 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:50.707633 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-92cf436a-5aec-43f9-abe9-c36dbd87ef12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:53.435010 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f6f25c6c-d2fc-43da-af34-ea6f135a9e2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:53.706407 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:54.337500 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:56.179327 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:58.988328 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33876) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:21:59.321725 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-164939515-network', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:21:59.344947 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Made reservation on behalf of edfe8167ea8b4027bb39f6b5ad4d2c57 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:21:59.347787 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.357411 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.460208 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.464509 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.496040 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b78095f5-08e4-4d5e-a244-cde8b0cc28b3,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:21:59.504299 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.504657 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.505196 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.505541 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.505884 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.506242 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.506581 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.506952 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.507314 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.507647 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.507971 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.508465 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Tracked resource versions report: Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: pushed versions: Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: { 'AddressGroup': {'1.2'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'ConntrackHelper': {'1.0'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Log': {'1.0'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Network': {'1.1'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Port': {'1.7'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'PortForwarding': {'1.2'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'QosPolicy': {'1.9'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroup': {'1.4'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SubPort': {'1.0'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Subnet': {'1.1'}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Trunk': {'1.1'}} Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: consumer versions: Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: HyperV agent@hv-cinder-80588: {}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'ConntrackHelper': '1.0', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Log': '1.0', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Network': '1.1', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Port': '1.7', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'PortForwarding': '1.2', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'QosPolicy': '1.9', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroup': '1.4', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SecurityGroupRule': '1.2', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'SubPort': '1.0', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Subnet': '1.1', Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: 'Trunk': '1.1'}} Sep 16 16:21:59.509621 dv-cinder-805887-15-iscsi neutron-server[93950]: {{(pid=93950) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:21:59.515548 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 721} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:21:59.527908 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.528593 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Added segment 8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd of type vlan for network 53267936-cd43-4d76-85cb-9474bc332b78 Sep 16 16:21:59.575393 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.601649 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.602635 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:21:59.603850 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.638389 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.6460955 Sep 16 16:21:59.639187 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33914) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:21:59.644489 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Request body: {'subnet': {'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-subnet', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:21:59.672083 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Made reservation on behalf of edfe8167ea8b4027bb39f6b5ad4d2c57 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:21:59.677038 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.688271 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c435ce-d32d-4261-9e97-3bbbe123ccbb admin admin] Pushing event updated for resources: {'Network': ['ID=53267936-cd43-4d76-85cb-9474bc332b78,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:21:59.701073 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 53267936-cd43-4d76-85cb-9474bc332b78 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:21:59.755676 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33928) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:21:59.870125 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.932366 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c1936e4e-27dd-43b2-be4a-1bdf226e79cc,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:21:59.935487 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Checking segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:21:59.935838 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Network hostable DHCP agents. Network: 53267936-cd43-4d76-85cb-9474bc332b78, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:21:59.942607 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.942980 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.943348 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.943680 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.944009 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.944358 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.944684 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.945022 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.945637 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.945756 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.946001 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.946316 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Tracked resource versions report: Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: pushed versions: Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: { 'AddressGroup': {'1.2'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'ConntrackHelper': {'1.0'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Log': {'1.0'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Network': {'1.1'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Port': {'1.7'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'PortForwarding': {'1.2'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'QosPolicy': {'1.9'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroup': {'1.4'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SubPort': {'1.0'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Subnet': {'1.1'}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Trunk': {'1.1'}} Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: consumer versions: Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: HyperV agent@hv-cinder-80588: {}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'ConntrackHelper': '1.0', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Log': '1.0', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Network': '1.1', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Port': '1.7', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'PortForwarding': '1.2', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'QosPolicy': '1.9', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroup': '1.4', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SecurityGroupRule': '1.2', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'SubPort': '1.0', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Subnet': '1.1', Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: 'Trunk': '1.1'}} Sep 16 16:21:59.947483 dv-cinder-805887-15-iscsi neutron-server[93951]: {{(pid=93951) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:21:59.964398 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Network 53267936-cd43-4d76-85cb-9474bc332b78 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:21:59.974983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 53267936-cd43-4d76-85cb-9474bc332b78) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:21:59.981304 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:21:59.982849 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:21:59.986437 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cff4de00-17ae-4f02-99da-48cbd7b64741 None None] Network 53267936-cd43-4d76-85cb-9474bc332b78 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:00.002483 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5cab9f8c-bf84-4f8e-acbe-d4090b7fa636 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 0.3622565 Sep 16 16:22:00.005456 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33946) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:00.011955 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:00.023235 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-183716530-network', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:00.053930 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.055571 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.137207 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35aecb19-ff0e-4c7d-8fdd-5e71a84e799f None None] Network 53267936-cd43-4d76-85cb-9474bc332b78 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:00.169655 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.250244 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33954) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:00.257071 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Made reservation on behalf of 36186b0d094344dbb7b6d93645ae77e1 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:00.260060 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.302799 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.340779 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.501131 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.511140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.524512 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 33972) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:00.555391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 33976) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:00.589528 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1165315102-network', 'tenant_id': '8142a9d3002f4b6d8aa31c635da07520'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:00.597397 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 737} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:22:00.613485 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Made reservation on behalf of 8142a9d3002f4b6d8aa31c635da07520 for: {'network': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:00.616081 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.625832 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.626018 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.626245 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Added segment bc28b78f-3dff-4b2d-a033-1d9b94c43842 of type vlan for network baca97e8-c07b-484a-a0fa-c440a2abcfed Sep 16 16:22:00.695590 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.721125 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.726069 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.726689 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.732535 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.753886 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 731} {{(pid=93951) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:22:00.784639 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.784977 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.segments_db [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Added segment 6f8c7cc7-81db-4318-8cb5-16b891d859e6 of type vlan for network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 Sep 16 16:22:00.795825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9917623a-7304-4264-9dbb-de2cfbbf57fb,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:00.848724 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Allocated IP 172.27.3.227 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/a72418ec-cdf5-4bb6-bd12-2486cbdc867d) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:00.925834 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f97f76e-27ef-4732-9de2-80d44bd52032,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:00.932153 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-836168250-network', 'tenant_id': '1e1430a98b404aeeb377f9360863aeaa'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:00.939688 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.941099 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:00.941981 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.944872 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1448494135-network', 'tenant_id': '0378b53234de487d8ebc6eeb3fbfbe5d'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:00.966067 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.991896 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.994945 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:00.996016 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:00.996558 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.054374 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] Pushing event updated for resources: {'Network': ['ID=baca97e8-c07b-484a-a0fa-c440a2abcfed,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:01.068622 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network baca97e8-c07b-484a-a0fa-c440a2abcfed details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:22:01.076757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] Pushing event updated for resources: {'Network': ['ID=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:01.084611 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Made reservation on behalf of 1e1430a98b404aeeb377f9360863aeaa for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:01.087891 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2998e15d-45fb-4276-b39b-2f80c08a053a admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.8362427 Sep 16 16:22:01.091342 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34000) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:01.095555 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.097607 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Request body: {'subnet': {'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1165315102-subnet', 'tenant_id': '8142a9d3002f4b6d8aa31c635da07520', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:01.116484 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Made reservation on behalf of 0378b53234de487d8ebc6eeb3fbfbe5d for: {'network': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:01.121363 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.126504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:22:01.132515 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.143586 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.171535 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Made reservation on behalf of 8142a9d3002f4b6d8aa31c635da07520 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:01.171904 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-42653d14-9f6d-488b-99e6-e8aabce5bd81 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.4115260 Sep 16 16:22:01.172940 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34002) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:01.176902 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.178899 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Request body: {'subnet': {'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-183716530-subnet', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:01.245032 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.312315 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.317018 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:01.328835 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:01.335645 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:01.381239 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Pushing event updated for resources: {'Port': ['ID=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:01.389441 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.db.api [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 16 16:22:01.389441 dv-cinder-805887-15-iscsi neutron-server[93950]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Sep 16 16:22:01.389441 dv-cinder-805887-15-iscsi neutron-server[93950]: [parameters: {'project_id_1': '1e1430a98b404aeeb377f9360863aeaa', 'expiration_1': datetime.datetime(2021, 9, 16, 16, 21, 41, 217715)}] Sep 16 16:22:01.389441 dv-cinder-805887-15-iscsi neutron-server[93950]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=93950) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 16 16:22:01.389849 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG oslo_db.api [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 16 16:22:01.485966 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.528078 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Made reservation on behalf of 36186b0d094344dbb7b6d93645ae77e1 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:01.530391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.531872 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 703} {{(pid=93951) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:22:01.597852 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d064230-2081-4062-abd9-634d63aa4380,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:01.638833 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.640140 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.segments_db [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Added segment 527820c5-a337-4239-b438-0c52b8d78dde of type vlan for network 143ad357-dcc1-47a6-a228-62d36164e62c Sep 16 16:22:01.765571 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.785214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.788789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.843310 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.844644 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:01.845437 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.903269 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e4933948-8e0f-4ede-a776-0bbd1e3c2a6c,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:01.921348 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.3921931 Sep 16 16:22:01.921720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:01.926899 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34034) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:01.938301 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Request body: {'subnet': {'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1448494135-subnet', 'tenant_id': '0378b53234de487d8ebc6eeb3fbfbe5d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:01.984565 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Checking segment: {'id': '6f8c7cc7-81db-4318-8cb5-16b891d859e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 731, 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:01.985113 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Network hostable DHCP agents. Network: b4c32c31-4aa7-4c54-bdb8-3e5674bb6304, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:22:02.005768 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.011150 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Made reservation on behalf of 0378b53234de487d8ebc6eeb3fbfbe5d for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:02.014365 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.054831 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8629eef1-da89-4eb7-8082-2b3f4804ef9d admin admin] Pushing event updated for resources: {'Network': ['ID=143ad357-dcc1-47a6-a228-62d36164e62c,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:02.070704 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 143ad357-dcc1-47a6-a228-62d36164e62c details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:22:02.077006 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:22:02.094340 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, b4c32c31-4aa7-4c54-bdb8-3e5674bb6304) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:02.102368 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:02.104345 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.159053 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e2474bf-c4c9-4916-8005-40a46bdddd09 None None] Network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:02.309064 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Checking segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:02.310167 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Network hostable DHCP agents. Network: baca97e8-c07b-484a-a0fa-c440a2abcfed, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:22:02.319442 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Pushing event updated for resources: {'Subnet': ['ID=94ba1df5-707c-4998-b69b-115427a08b60,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:02.364619 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3905dfd-47e8-4ba1-b7ed-3f81b32c16d9 None None] Network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:02.389592 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.512665 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Network baca97e8-c07b-484a-a0fa-c440a2abcfed is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:22:02.539831 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, baca97e8-c07b-484a-a0fa-c440a2abcfed) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:02.548227 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b65028e7-c24f-49e1-a2b3-2da6a79a4a37 None None] Network baca97e8-c07b-484a-a0fa-c440a2abcfed requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:02.560151 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:02.560891 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.580985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.596903 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c3a2dfeb-5a83-4779-936d-4e1feff72925 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.5036280 Sep 16 16:22:02.652760 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.657473 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.708355 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 732} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:22:02.715057 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0d18a491-22a5-4d6c-9b38-9ad23c3ed711 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.5368686 Sep 16 16:22:02.716233 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34058) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:02.721019 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:02.761981 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.763134 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.765420 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=982606c1-0388-4321-af40-ac23387bf5dd,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:02.769308 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.769717 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Added segment 992a4661-dd54-4305-a4be-139efbcde69f of type vlan for network 0420b7a3-0c00-47c7-bd02-e66e625d489b Sep 16 16:22:02.784420 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-baca97e8-c07b-484a-a0fa-c440a2abcfed', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:22:02.792189 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.844545 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Pushing event updated for resources: {'Subnet': ['ID=57a636e1-0951-4c2f-8be2-8ca36acb1d05,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:02.851182 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.863865 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.871302 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Checking segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:02.871629 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Network hostable DHCP agents. Network: 143ad357-dcc1-47a6-a228-62d36164e62c, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:22:02.876163 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93950) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:22:02.953739 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.954710 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:02.955281 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:02.961480 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Network 143ad357-dcc1-47a6-a228-62d36164e62c is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:22:03.010806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 143ad357-dcc1-47a6-a228-62d36164e62c) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:03.015632 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 2.4573121 Sep 16 16:22:03.017111 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:03.017697 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.021884 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb31282c-85da-4323-8f34-38f8b756555d None None] Network 143ad357-dcc1-47a6-a228-62d36164e62c requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:03.031842 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34078) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:03.042260 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Request body: {'subnet': {'network_id': '0420b7a3-0c00-47c7-bd02-e66e625d489b', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-836168250-subnet', 'tenant_id': '1e1430a98b404aeeb377f9360863aeaa', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:03.072672 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.113467 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-03ff7db1-c282-43dc-9225-c99a7ee26449 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.1763155 Sep 16 16:22:03.118240 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Allocated IP 172.20.0.2 (baca97e8-c07b-484a-a0fa-c440a2abcfed/94ba1df5-707c-4998-b69b-115427a08b60/716bea06-3227-4474-9309-79e02d67ed2d) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:03.141350 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a8bd30-89f6-442c-8e64-421de6da80e8 admin admin] Pushing event updated for resources: {'Network': ['ID=0420b7a3-0c00-47c7-bd02-e66e625d489b,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:03.165112 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Made reservation on behalf of 1e1430a98b404aeeb377f9360863aeaa for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:03.168216 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.173851 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:22:03.205323 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Sync routers for ids ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:22:03.218795 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34106) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:03.229820 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Routers {'794079ca-8b9e-4ee4-9e49-75b36d31fc11'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:03.230280 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 16 16:22:03.230572 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:03.266345 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.267713 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-79b93fd2-7e05-4a25-8bdd-6eeb38082ae5 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 3.2611129 Sep 16 16:22:03.271159 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34108) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:03.420517 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 0420b7a3-0c00-47c7-bd02-e66e625d489b details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:22:03.467603 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-780616be-5df8-486c-b3c9-f82b24315f0a None None] Network 143ad357-dcc1-47a6-a228-62d36164e62c requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:03.529458 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-f8e76bbe-654b-41fe-930f-10a5e03beed5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:03.530991 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-f8e76bbe-654b-41fe-930f-10a5e03beed5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/networks?id=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 HTTP/1.1" status: 200 len: 812 time: 0.3111806 Sep 16 16:22:03.543057 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Set router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:03.761141 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.833411 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.865676 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-c3dfea1b-3bb0-476d-95f7-a6a52bbcb0c5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/quotas/8142a9d3002f4b6d8aa31c635da07520 HTTP/1.1" status: 200 len: 375 time: 0.0407493 Sep 16 16:22:03.868315 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34138) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:03.875300 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 16 16:22:03.905303 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:01Z', 'revision_number': 3, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:03.932330 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Checking router: 794079ca-8b9e-4ee4-9e49-75b36d31fc11 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:22:03.932998 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Updating router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 port a72418ec-cdf5-4bb6-bd12-2486cbdc867d binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:22:03.964005 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-0d1e49ca-5674-48b7-8a93-2bca8cd8fb0f tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=8142a9d3002f4b6d8aa31c635da07520&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0831981 Sep 16 16:22:03.964005 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:03.995714 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.086577 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Checking segment: {'id': '992a4661-dd54-4305-a4be-139efbcde69f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': '0420b7a3-0c00-47c7-bd02-e66e625d489b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:04.086996 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Network hostable DHCP agents. Network: 0420b7a3-0c00-47c7-bd02-e66e625d489b, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:22:04.106790 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8cb06189-beb9-4324-98e3-4182d30fc87b,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:04.141165 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.157482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.160377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Network 0420b7a3-0c00-47c7-bd02-e66e625d489b is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:22:04.214975 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 0420b7a3-0c00-47c7-bd02-e66e625d489b) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:04.225711 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-92b427ca-d2e5-41a9-aeab-3b74a9f45803 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:04.227882 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-92b427ca-d2e5-41a9-aeab-3b74a9f45803 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.3570411 Sep 16 16:22:04.229538 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-103f4e8c-3ade-4f4c-a01e-c520ced93b8e None None] Network 0420b7a3-0c00-47c7-bd02-e66e625d489b requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:04.236076 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:04.236685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.295248 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-59a27ad5-404f-401d-ae20-3e2758afc004 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.2489986 Sep 16 16:22:04.312895 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-a1399de4-274d-483a-b68b-a7aabae5b4f3 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93950) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:22:04.313946 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-a1399de4-274d-483a-b68b-a7aabae5b4f3 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1483626 Sep 16 16:22:04.326456 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Network baca97e8-c07b-484a-a0fa-c440a2abcfed is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:04.340642 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:04.344759 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:04.361954 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Pushing event updated for resources: {'Port': ['ID=716bea06-3227-4474-9309-79e02d67ed2d,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:04.444005 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.444368 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.444798 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.445108 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.445449 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.445766 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.446088 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.446411 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.446755 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.447141 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.447987 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.448307 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Tracked resource versions report: Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: pushed versions: Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: { 'AddressGroup': {'1.2'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'ConntrackHelper': {'1.0'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Log': {'1.0'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Network': {'1.1'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Port': {'1.7'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'PortForwarding': {'1.2'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'QosPolicy': {'1.9'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroup': {'1.4'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SubPort': {'1.0'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Subnet': {'1.1'}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Trunk': {'1.1'}} Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: consumer versions: Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: HyperV agent@hv-cinder-80588: {}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'ConntrackHelper': '1.0', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Log': '1.0', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Network': '1.1', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Port': '1.7', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'PortForwarding': '1.2', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'QosPolicy': '1.9', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroup': '1.4', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SecurityGroupRule': '1.2', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'SubPort': '1.0', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Subnet': '1.1', Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: 'Trunk': '1.1'}} Sep 16 16:22:04.449454 dv-cinder-805887-15-iscsi neutron-server[93952]: {{(pid=93952) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:22:04.471139 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Attempting to bind port 716bea06-3227-4474-9309-79e02d67ed2d on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:04.471530 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Attempting to bind port 716bea06-3227-4474-9309-79e02d67ed2d by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:04.471893 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Attempting to bind port 716bea06-3227-4474-9309-79e02d67ed2d on network baca97e8-c07b-484a-a0fa-c440a2abcfed {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:04.479093 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 21, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:04.479651 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Checking segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:04.479899 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.481269 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Bound using segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:04.481269 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Bound port: 716bea06-3227-4474-9309-79e02d67ed2d, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:04.481269 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.518965 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.520033 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-5462c39a-41a9-431d-85a9-456f6148e599 service neutron] 10.222.0.59 "GET /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1990993 Sep 16 16:22:04.532676 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.553039 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-920b0ff8-defc-472e-bb02-6bd9d50b7be9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/quotas/0378b53234de487d8ebc6eeb3fbfbe5d HTTP/1.1" status: 200 len: 375 time: 0.0311301 Sep 16 16:22:04.600389 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Attempting to bind port a72418ec-cdf5-4bb6-bd12-2486cbdc867d on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:04.601029 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Attempting to bind port a72418ec-cdf5-4bb6-bd12-2486cbdc867d by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:04.601390 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Attempting to bind port a72418ec-cdf5-4bb6-bd12-2486cbdc867d on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:04.612994 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 21, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:04.613619 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:04.614177 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.614734 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:04.615482 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Bound port: a72418ec-cdf5-4bb6-bd12-2486cbdc867d, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:04.616056 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.619464 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Pushing event updated for resources: {'Port': ['ID=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,revision_number=2']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:04.647937 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.648663 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.649184 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.649699 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.650261 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.650779 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.651361 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.651886 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.652419 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.652922 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.653629 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.653872 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Tracked resource versions report: Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: pushed versions: Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: { 'AddressGroup': {'1.2'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'ConntrackHelper': {'1.0'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Log': {'1.0'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Network': {'1.1'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Port': {'1.7'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'PortForwarding': {'1.2'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'QosPolicy': {'1.9'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroup': {'1.4'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroupRule': {'1.2'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SubPort': {'1.0'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Subnet': {'1.1'}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Trunk': {'1.1'}} Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: consumer versions: Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: { DHCP agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: HyperV agent@hv-cinder-80588: {}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: L3 agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: Metadata agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: Metering agent@dv-cinder-805887-15-iscsi: {}, Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: Open vSwitch agent@dv-cinder-805887-15-iscsi: { 'AddressGroup': '1.2', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'ConntrackHelper': '1.0', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Log': '1.0', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Network': '1.1', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Port': '1.7', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'PortForwarding': '1.2', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'QosPolicy': '1.9', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroup': '1.4', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SecurityGroupRule': '1.2', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'SubPort': '1.0', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Subnet': '1.1', Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: 'Trunk': '1.1'}} Sep 16 16:22:04.656049 dv-cinder-805887-15-iscsi neutron-server[93953]: {{(pid=93953) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 16 16:22:04.660350 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-0665900a-45a9-4296-ac7a-9daa0ec00fa1 service neutron] 10.222.0.59 "GET /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306789 Sep 16 16:22:04.698341 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] For port a72418ec-cdf5-4bb6-bd12-2486cbdc867d, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:04.702767 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] For port a72418ec-cdf5-4bb6-bd12-2486cbdc867d, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:04.709966 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.710682 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efc1190f-3103-4113-9445-d06e1b16d89f None None] Network 0420b7a3-0c00-47c7-bd02-e66e625d489b requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:04.765448 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-0fffeb5c-2d1d-434a-a89d-3e03238aff64 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2114885 Sep 16 16:22:04.802678 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f5c9db5-af0a-4a78-85fb-a1cd40e7d45f None None] Pushing event updated for resources: {'Port': ['ID=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:04.819701 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Routers {'794079ca-8b9e-4ee4-9e49-75b36d31fc11'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:04.821250 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:04.843517 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] For port 716bea06-3227-4474-9309-79e02d67ed2d, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:04.861543 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] For port 716bea06-3227-4474-9309-79e02d67ed2d, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=716bea06-3227-4474-9309-79e02d67ed2d,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:04.874694 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:04.970861 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c99250-5f50-48b3-b38c-c2382a05be29 None None] Pushing event updated for resources: {'Port': ['ID=716bea06-3227-4474-9309-79e02d67ed2d,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:05.007817 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] Set router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:05.045509 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Allocated IP 172.27.3.209 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/d94e6d19-6301-4628-a0ba-e2677178f7c9) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:05.191344 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-61a6b50c-d6d3-47c1-8cd2-ec15fc1c3a83 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:22:05.203520 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-61a6b50c-d6d3-47c1-8cd2-ec15fc1c3a83 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2399197 Sep 16 16:22:05.351761 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-9ada3a1c-4a66-4a51-91f6-2096a4ad22d2 service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1473165 Sep 16 16:22:05.389368 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7e4360d5-3571-481f-845d-4e80ab517957 req-8369733d-1d46-404f-b231-4347b288cb8e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.1396341 Sep 16 16:22:05.408079 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:01Z', 'revision_number': 3, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:05.452500 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.481108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34206) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:05.489423 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64a94974-f2ad-4e86-bdce-9289a2062dfc None None] The sync data for ids ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'] in dv-cinder-805887-15-iscsi is: [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:01Z', 'revision_number': 3, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:22:05.494570 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-196949199-network', 'tenant_id': '0c2e6bf0a1ce49e4980468e273625322'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:05.557909 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Made reservation on behalf of 0c2e6bf0a1ce49e4980468e273625322 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:05.566755 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.594876 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.608951 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.664244 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 716bea06-3227-4474-9309-79e02d67ed2d up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:05.756535 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 716bea06-3227-4474-9309-79e02d67ed2d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:05.756908 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.785505 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.794063 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.814282 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 712} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:22:05.823816 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.844003 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.844334 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Added segment f9f64338-0b81-47ec-a304-6197c8e2fa2f of type vlan for network 14b36022-d039-441d-9869-876e0a7d0bbe Sep 16 16:22:05.845880 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7835c81-f2cf-425b-af80-d81f44fcd9a2,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:05.887980 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-5a071f44-5dbb-499f-80ea-84c63b5e9803 service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5351782 Sep 16 16:22:05.897210 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.947222 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.957050 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 716bea06-3227-4474-9309-79e02d67ed2d, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=716bea06-3227-4474-9309-79e02d67ed2d,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:05.970557 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:05.984388 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:05.991183 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:05.998124 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:05.999771 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.001039 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:06.003833 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.030938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Pushing event updated for resources: {'Port': ['ID=d94e6d19-6301-4628-a0ba-e2677178f7c9,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:06.088620 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=716bea06-3227-4474-9309-79e02d67ed2d,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:06.140132 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.6577275 Sep 16 16:22:06.141953 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f5f47e-2ed0-42c2-817b-6c63a91d576f admin admin] Pushing event updated for resources: {'Network': ['ID=14b36022-d039-441d-9869-876e0a7d0bbe,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:06.144391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34226) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:06.154359 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 14b36022-d039-441d-9869-876e0a7d0bbe details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:22:06.160002 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Request body: {'subnet': {'network_id': '14b36022-d039-441d-9869-876e0a7d0bbe', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-196949199-subnet', 'tenant_id': '0c2e6bf0a1ce49e4980468e273625322', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:06.236103 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Made reservation on behalf of 0c2e6bf0a1ce49e4980468e273625322 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:06.239394 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.368549 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Allocated IP 172.20.0.1 (53267936-cd43-4d76-85cb-9474bc332b78/c1936e4e-27dd-43b2-be4a-1bdf226e79cc/ed36e85b-3ccd-4d09-afaa-2def955b8b7c) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:06.560274 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b2e6691b-0e83-4d40-b3fa-ff7a1b740fd3 req-e299eeb1-e093-49e1-9252-08435e36f33a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.1509488 Sep 16 16:22:06.639619 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-779816f5-de36-4a3b-aafd-52f9d44d983f None None] Network baca97e8-c07b-484a-a0fa-c440a2abcfed requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:06.789611 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e5ed4df4-1a88-4c96-b967-689495db0742 req-e495747c-8daf-4c78-badd-f3d5a9a7c929 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.1686985 Sep 16 16:22:06.804727 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.874423 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-1afbaee8-6d21-46e5-83c0-ec546f7b7b04 None None] Provisioning complete for port 716bea06-3227-4474-9309-79e02d67ed2d triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:06.875682 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1afbaee8-6d21-46e5-83c0-ec546f7b7b04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.877980 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.916492 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:06.994985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e135ba7c-e0bf-400c-aef4-6a6a906a37cf,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:07.002810 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Checking segment: {'id': 'f9f64338-0b81-47ec-a304-6197c8e2fa2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 712, 'network_id': '14b36022-d039-441d-9869-876e0a7d0bbe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:07.005543 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Network hostable DHCP agents. Network: 14b36022-d039-441d-9869-876e0a7d0bbe, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:22:07.032464 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Network 14b36022-d039-441d-9869-876e0a7d0bbe is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:22:07.058206 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 14b36022-d039-441d-9869-876e0a7d0bbe) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:07.081202 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:07.082453 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.096842 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.107175 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6510acce-97fc-4544-a918-bf9558321b1b None None] Network 14b36022-d039-441d-9869-876e0a7d0bbe requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:07.111431 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-d4e07070-0755-4bd7-80e0-259485311dd0 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.9540386 Sep 16 16:22:07.364127 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eeb35708-3720-4772-9487-17b9886f242d None None] Network 14b36022-d039-441d-9869-876e0a7d0bbe requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:22:07.393535 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34278) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:07.396879 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Network 53267936-cd43-4d76-85cb-9474bc332b78 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:07.426818 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:07.430967 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Pushing event updated for resources: {'Port': ['ID=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:07.470011 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:07.470558 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.516337 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Deleting subnet 8cb06189-beb9-4324-98e3-4182d30fc87b {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:22:07.521384 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.590340 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.602912 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.607712 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-5aff144d-e6e9-4b4d-adc3-f26a06b6476c None None] Provisioning complete for port 716bea06-3227-4474-9309-79e02d67ed2d triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:07.608157 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5aff144d-e6e9-4b4d-adc3-f26a06b6476c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.612039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.698785 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f1aae358-0008-499b-9552-12c776d3ffe0 req-456a9af0-ca16-464d-b6bd-e0c0598f0baf tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.0528760 Sep 16 16:22:07.763556 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.824214 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 716bea06-3227-4474-9309-79e02d67ed2d up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:07.839180 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8cb06189-beb9-4324-98e3-4182d30fc87b,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:07.853972 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.864829 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-b22ad0cf-5006-451b-8a47-2c1e76006e23 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/8cb06189-beb9-4324-98e3-4182d30fc87b HTTP/1.1" status: 204 len: 168 time: 0.4705720 Sep 16 16:22:07.869726 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34300) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:07.932998 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 716bea06-3227-4474-9309-79e02d67ed2d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:07.933624 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:07.934837 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Router da1aab41-d805-4a4f-a252-59e579ace211 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93951) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:22:07.971778 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.084052 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.183231 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device a72418ec-cdf5-4bb6-bd12-2486cbdc867d up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:08.193668 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.66', 56924) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:08.408992 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port a72418ec-cdf5-4bb6-bd12-2486cbdc867d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:08.408992 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.409388 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e1428210-3046-468c-b683-35eb148766a1 req-42c88435-f8e2-48cf-8cef-ebd2b5e74ce1 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.1250894 Sep 16 16:22:08.423733 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.461069 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:22:08.479006 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.479738 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.480260 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.480660 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > port after_create 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.481685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > port after_delete 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.481685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > port after_update 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.481953 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.482513 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.482661 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.482964 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.497944 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:22:08.502978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-947244d1-f48b-4add-a62e-7ea25bd6d006 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:08.505314 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-947244d1-f48b-4add-a62e-7ea25bd6d006 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.66 "GET /v2.0/networks?id=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 HTTP/1.1" status: 200 len: 812 time: 0.3088417 Sep 16 16:22:08.518648 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.520122 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-eaa3cf81-fc8d-4a6f-88f9-8bab65dfb33f admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 5.8028684 Sep 16 16:22:08.523584 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34326) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:08.569745 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:08.588174 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:08.596469 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Request body: {'port': {'device_id': '68798125-7e39-4c0b-807d-f17667e701f2', 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304', 'admin_state_up': True, 'tenant_id': '8142a9d3002f4b6d8aa31c635da07520'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:08.676916 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.745416 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.801813 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.810461 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.843410 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.843596 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port a72418ec-cdf5-4bb6-bd12-2486cbdc867d, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:08.856063 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.859727 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.860300 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=93950) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:22:08.860477 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.863713 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0420b7a3-0c00-47c7-bd02-e66e625d489b']}} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:08.871308 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:08.892343 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '992a4661-dd54-4305-a4be-139efbcde69f') {'for_net_delete': True} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:08.892652 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '992a4661-dd54-4305-a4be-139efbcde69f') {} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:08.918174 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64152858'] for segment, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.947591 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.960301 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Releasing vlan 732 on physical network physnet1 to pool {{(pid=93950) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:22:08.960948 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-65204239'] for segment, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: from cryptography.utils import int_from_bytes Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: from cryptography.utils import int_from_bytes Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: Traceback (most recent call last): Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: timer() Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: cb(*args, **kw) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: return func(*args, **kwargs) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: self._notify() Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: self.callback(batched_events) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: event.method(event) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: return f(self, *a, **k) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._get(url).json() Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: return self.request(url, 'GET', **kwargs) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:22:08.972391 dv-cinder-805887-15-iscsi neutron-server[93950]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:22:09.049193 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:09.050767 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.068133 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.073458 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] 10.222.0.59 "DELETE /v2.0/networks/0420b7a3-0c00-47c7-bd02-e66e625d489b HTTP/1.1" status: 204 len: 168 time: 1.1994364 Sep 16 16:22:09.080884 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34364) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:09.081077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Pushing event updated for resources: {'Port': ['ID=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:09.093939 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a435414-c9d3-4e01-a7f3-701111a09e72 admin admin] Pushing event deleted for resources: {'Network': ['ID=0420b7a3-0c00-47c7-bd02-e66e625d489b,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:09.132720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Deleting subnet e135ba7c-e0bf-400c-aef4-6a6a906a37cf {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:22:09.136493 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.156508 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:06Z', 'revision_number': 3, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:09.172548 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-af9a504a-b718-4bfe-9390-5af39cc872bc req-b1f7c0e5-0373-48f8-b184-ca194187ad62 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.0480707 Sep 16 16:22:09.186548 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.197538 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:22:09.208081 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Updating router da1aab41-d805-4a4f-a252-59e579ace211 port d94e6d19-6301-4628-a0ba-e2677178f7c9 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:22:09.215231 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Made reservation on behalf of 8142a9d3002f4b6d8aa31c635da07520 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:09.218693 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.238885 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.246105 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.280827 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Network 53267936-cd43-4d76-85cb-9474bc332b78 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:09.294781 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:09.324470 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.359906 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e135ba7c-e0bf-400c-aef4-6a6a906a37cf,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:09.438516 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.440688 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-8f1c1323-0eab-4eee-81ae-f19dd7756e68 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/e135ba7c-e0bf-400c-aef4-6a6a906a37cf HTTP/1.1" status: 204 len: 168 time: 0.3585351 Sep 16 16:22:09.443806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34374) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:09.496240 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-48d7beff-28c2-4a4e-b455-9c2b2eb96020 req-be42936a-7dc6-4e8f-a220-831af54d6ef3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.0431283 Sep 16 16:22:09.627902 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.627902 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device a72418ec-cdf5-4bb6-bd12-2486cbdc867d up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:09.651617 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.683465 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.725595 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd0a242-a2e9-4817-ab7a-f6e54a5ae078 None None] Pushing event updated for resources: {'Port': ['ID=d94e6d19-6301-4628-a0ba-e2677178f7c9,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:09.728451 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Attempting to bind port d94e6d19-6301-4628-a0ba-e2677178f7c9 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:09.728451 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Attempting to bind port d94e6d19-6301-4628-a0ba-e2677178f7c9 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:09.729035 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Attempting to bind port d94e6d19-6301-4628-a0ba-e2677178f7c9 on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:09.739509 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 21, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:09.740465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:09.740966 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.741449 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:09.742020 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Bound port: d94e6d19-6301-4628-a0ba-e2677178f7c9, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:09.742519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.748728 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port a72418ec-cdf5-4bb6-bd12-2486cbdc867d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:09.749232 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.780252 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.817849 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14b36022-d039-441d-9869-876e0a7d0bbe']}} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:09.828723 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f9f64338-0b81-47ec-a304-6197c8e2fa2f') {'for_net_delete': True} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:09.829015 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f9f64338-0b81-47ec-a304-6197c8e2fa2f') {} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:09.839597 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64152858'] for segment, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.852351 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] For port d94e6d19-6301-4628-a0ba-e2677178f7c9, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:09.854175 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.855976 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] For port d94e6d19-6301-4628-a0ba-e2677178f7c9, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d94e6d19-6301-4628-a0ba-e2677178f7c9,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:09.861253 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Releasing vlan 712 on physical network physnet1 to pool {{(pid=93950) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:22:09.861747 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-65204239'] for segment, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: Traceback (most recent call last): Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: timer() Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: cb(*args, **kw) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: return func(*args, **kwargs) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: self._notify() Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: self.callback(batched_events) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: event.method(event) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: return f(self, *a, **k) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._get(url).json() Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: return self.request(url, 'GET', **kwargs) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:22:09.864132 dv-cinder-805887-15-iscsi neutron-server[93950]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:22:09.866458 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.937770 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.944375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Allocated IP 172.20.0.14 (b4c32c31-4aa7-4c54-bdb8-3e5674bb6304/e4933948-8e0f-4ede-a776-0bbd1e3c2a6c/e23a376e-556e-4737-ada1-f038ddbcf060) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:09.950393 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:09.956939 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] 10.222.0.59 "DELETE /v2.0/networks/14b36022-d039-441d-9869-876e0a7d0bbe HTTP/1.1" status: 204 len: 168 time: 0.5119343 Sep 16 16:22:09.963749 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:22:09.979797 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf13cea-cc6c-4082-b76f-ccbad05a8315 admin admin] Pushing event deleted for resources: {'Network': ['ID=14b36022-d039-441d-9869-876e0a7d0bbe,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:10.009589 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd0a242-a2e9-4817-ab7a-f6e54a5ae078 None None] Pushing event updated for resources: {'Port': ['ID=d94e6d19-6301-4628-a0ba-e2677178f7c9,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:10.011971 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:10.018896 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:10.125439 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:10.159355 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34386) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:10.222879 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-68e67267-4034-42d4-83b9-dceff3fabdcc admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=1e1430a98b404aeeb377f9360863aeaa&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0623674 Sep 16 16:22:10.223486 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34390) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:10.238185 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.254162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:22:10.264834 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-66d80e05-5cec-4ba0-9dcf-3e37d314ccec admin admin] 10.222.0.59 "PUT /v2.0/routers/794079ca-8b9e-4ee4-9e49-75b36d31fc11/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9923005 Sep 16 16:22:10.266135 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Sync routers for ids ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:22:10.291647 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Routers {'794079ca-8b9e-4ee4-9e49-75b36d31fc11'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:10.292409 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:10.301411 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.314953 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-89feafcd-adf6-4736-a0b1-41b4cb726f5e req-988b6daa-ad5d-4b72-805b-beda689c7f5b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.0413766 Sep 16 16:22:10.333958 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-505c4798-8707-4ead-94e5-301381567435 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.372109 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-505c4798-8707-4ead-94e5-301381567435 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.383784 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:06Z', 'revision_number': 3, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:10.398795 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.419543 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da509c1-02c2-4253-baaf-9340aec23c7a None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:06Z', 'revision_number': 3, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:22:10.460357 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-505c4798-8707-4ead-94e5-301381567435 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.462917 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-505c4798-8707-4ead-94e5-301381567435 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.464114 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-505c4798-8707-4ead-94e5-301381567435 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/982606c1-0388-4321-af40-ac23387bf5dd HTTP/1.1" status: 204 len: 168 time: 0.2395890 Sep 16 16:22:10.471676 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505c4798-8707-4ead-94e5-301381567435 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=982606c1-0388-4321-af40-ac23387bf5dd,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:10.574025 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:10.577284 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Set router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:10.590097 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:10.601155 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:10.608646 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:10.609165 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.688754 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Pushing event updated for resources: {'Port': ['ID=e23a376e-556e-4737-ada1-f038ddbcf060,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:10.718571 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb24b07e-c20f-42aa-9e59-ecb1a400802c req-d5297f28-0f7e-498a-9967-ab5de6bc11f3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:10.719864 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-13ec9a3e-8168-433f-9198-0229994c2f0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1309867 Sep 16 16:22:10.727461 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bb24b07e-c20f-42aa-9e59-ecb1a400802c req-d5297f28-0f7e-498a-9967-ab5de6bc11f3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 932 time: 0.0995076 Sep 16 16:22:10.739036 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Allocated IP 172.20.0.1 (baca97e8-c07b-484a-a0fa-c440a2abcfed/94ba1df5-707c-4998-b69b-115427a08b60/21f70636-78ad-426a-af75-45688a14aabf) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:10.853904 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bb24b07e-c20f-42aa-9e59-ecb1a400802c req-386bf9d5-2951-4ab1-950e-59928e6b2bed tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807793 Sep 16 16:22:10.951343 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:07Z', 'revision_number': 4, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'ed36e85b-3ccd-4d09-afaa-2def955b8b7c', 'name': '', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'mac_address': 'fa:16:3e:06:9a:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_interface', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:05Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 2, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'subnets': [{'id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:10.961686 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:10.984443 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Checking router: 794079ca-8b9e-4ee4-9e49-75b36d31fc11 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:22:10.984814 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Updating router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 port ed36e85b-3ccd-4d09-afaa-2def955b8b7c binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:22:11.016646 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.020007 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.088067 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Network baca97e8-c07b-484a-a0fa-c440a2abcfed is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:11.104634 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:11.114988 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:11.115691 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.181719 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Pushing event updated for resources: {'Port': ['ID=21f70636-78ad-426a-af75-45688a14aabf,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:11.235736 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34424) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:11.301357 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7e25329a-ea00-4106-9a0a-d8e64d5ec77f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0c2e6bf0a1ce49e4980468e273625322&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0637352 Sep 16 16:22:11.303672 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34426) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:11.373794 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-bb0b7f07-92fd-4425-a17a-2ea9650cb318 None None] Provisioning complete for port 21f70636-78ad-426a-af75-45688a14aabf triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:11.374329 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-bb0b7f07-92fd-4425-a17a-2ea9650cb318 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.430993 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3521d409-8944-4c71-b6fd-f69931ae606d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.433180 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-2006af45-6753-46d3-93f8-dc30b1bbdc78 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:11.436818 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.443001 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-2006af45-6753-46d3-93f8-dc30b1bbdc78 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 818 time: 0.2627258 Sep 16 16:22:11.445821 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-bb0b7f07-92fd-4425-a17a-2ea9650cb318 None None] Port 21f70636-78ad-426a-af75-45688a14aabf cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:22:11.450733 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.470103 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-7aec74dc-7af7-4daa-bb0a-741482d4ddab tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/quotas/edfe8167ea8b4027bb39f6b5ad4d2c57 HTTP/1.1" status: 200 len: 375 time: 0.0256903 Sep 16 16:22:11.484039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.501694 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd26466a-e667-45f9-862f-29296d32563a req-4357a897-9b99-4af4-927b-d71a5946ff92 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.0435369 Sep 16 16:22:11.503577 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3521d409-8944-4c71-b6fd-f69931ae606d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.533352 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab09fba3-34c9-45d7-843a-5f4c4dc298a7 None None] Pushing event updated for resources: {'Port': ['ID=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:11.590208 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3521d409-8944-4c71-b6fd-f69931ae606d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.592968 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3521d409-8944-4c71-b6fd-f69931ae606d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.596469 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3521d409-8944-4c71-b6fd-f69931ae606d admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f7835c81-f2cf-425b-af80-d81f44fcd9a2 HTTP/1.1" status: 204 len: 168 time: 0.2892835 Sep 16 16:22:11.602624 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Attempting to bind port ed36e85b-3ccd-4d09-afaa-2def955b8b7c on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:11.603269 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Attempting to bind port ed36e85b-3ccd-4d09-afaa-2def955b8b7c by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:11.603831 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Attempting to bind port ed36e85b-3ccd-4d09-afaa-2def955b8b7c on network 53267936-cd43-4d76-85cb-9474bc332b78 {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:11.613715 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3521d409-8944-4c71-b6fd-f69931ae606d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7835c81-f2cf-425b-af80-d81f44fcd9a2,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:11.616397 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 21, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:11.617225 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Checking segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:11.617842 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.618712 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Bound using segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:11.619550 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Bound port: ed36e85b-3ccd-4d09-afaa-2def955b8b7c, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:11.620051 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.624065 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-3949a387-2c72-433f-a075-2114780c9b76 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1528678 Sep 16 16:22:11.662219 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d94e6d19-6301-4628-a0ba-e2677178f7c9 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:11.720088 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] For port ed36e85b-3ccd-4d09-afaa-2def955b8b7c, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:11.725558 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] For port ed36e85b-3ccd-4d09-afaa-2def955b8b7c, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:11.741785 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.782160 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port d94e6d19-6301-4628-a0ba-e2677178f7c9 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:11.782550 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:11.850817 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab09fba3-34c9-45d7-843a-5f4c4dc298a7 None None] Pushing event updated for resources: {'Port': ['ID=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,revision_number=4']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:11.860161 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Routers {'794079ca-8b9e-4ee4-9e49-75b36d31fc11'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:11.863279 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:11.933894 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-aa0c2c3e-b044-4be7-b74a-3079af77f5b5 service neutron] 10.222.0.59 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2928076 Sep 16 16:22:12.022181 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f846f89-2964-4aba-a44f-28c04942424e req-0de9ef77-0f83-413c-9c99-d42d1f0b7a09 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:12.036061 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9f846f89-2964-4aba-a44f-28c04942424e req-0de9ef77-0f83-413c-9c99-d42d1f0b7a09 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 932 time: 0.1235602 Sep 16 16:22:12.083837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:12.160956 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] Set router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:12.162967 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9f846f89-2964-4aba-a44f-28c04942424e req-3667c8f4-b59e-434d-9011-8a0524c9c3a2 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1258571 Sep 16 16:22:12.174700 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port d94e6d19-6301-4628-a0ba-e2677178f7c9, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d94e6d19-6301-4628-a0ba-e2677178f7c9,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:12.187667 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:12.423637 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.66', 56936) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:12.432435 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=d94e6d19-6301-4628-a0ba-e2677178f7c9,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:12.644842 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-ed6ecb10-e651-4ddb-af2e-f11815b41e33 service neutron] 10.222.0.59 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7098341 Sep 16 16:22:12.674833 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-a3e59cf7-70c2-46ac-a2cf-06c03945d965 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:22:12.685493 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-a3e59cf7-70c2-46ac-a2cf-06c03945d965 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1258755 Sep 16 16:22:12.716594 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:12.737158 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:12.747186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:12.783393 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:07Z', 'revision_number': 4, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'ed36e85b-3ccd-4d09-afaa-2def955b8b7c', 'name': '', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'mac_address': 'fa:16:3e:06:9a:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_interface', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:05Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'subnets': [{'id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:12.820108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-6c458229-3664-4125-8fad-3e2c3c2a29db tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:12.821725 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-6c458229-3664-4125-8fad-3e2c3c2a29db tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.3894017 Sep 16 16:22:12.878550 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bc0818-d551-4144-8b87-dcd75724b9ef None None] The sync data for ids ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'] in dv-cinder-805887-15-iscsi is: [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:07Z', 'revision_number': 4, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'ed36e85b-3ccd-4d09-afaa-2def955b8b7c', 'name': '', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'mac_address': 'fa:16:3e:06:9a:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_interface', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:05Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'subnets': [{'id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:22:12.934839 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8456e059-867f-4803-af6b-bb9ccebcc139 req-994b7f88-fa67-4dfb-ab3a-bba5caa956fe tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.1041696 Sep 16 16:22:12.958560 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Request body: {'port': {'device_id': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'admin_state_up': True, 'tenant_id': '0378b53234de487d8ebc6eeb3fbfbe5d'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:13.075047 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Pushing event updated for resources: {'Port': ['ID=21f70636-78ad-426a-af75-45688a14aabf,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:13.362978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Request body: {'port': {'device_id': '68798125-7e39-4c0b-807d-f17667e701f2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:13.549514 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Network baca97e8-c07b-484a-a0fa-c440a2abcfed is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:13.566532 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:13.818433 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:13.876670 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d94e6d19-6301-4628-a0ba-e2677178f7c9 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:14.096890 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port d94e6d19-6301-4628-a0ba-e2677178f7c9 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:14.097270 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:14.132845 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07388751-05e7-4221-a4ed-82d4a55101bf req-605582aa-0d8d-4edf-baa4-17136c51c177 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.1541288 Sep 16 16:22:14.145730 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Router da1aab41-d805-4a4f-a252-59e579ace211 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:22:14.176997 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34528) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:14.204291 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Made reservation on behalf of 0378b53234de487d8ebc6eeb3fbfbe5d for: {'port': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:14.208243 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:14.293770 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e9407f-c652-4128-b3f3-9a423bdeb076 req-070b642c-4e95-4155-8957-7d99ac0f0237 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:14.296901 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-cff41709-5ace-4042-841a-987b52962085 None None] Provisioning complete for port 21f70636-78ad-426a-af75-45688a14aabf triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:14.298154 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-cff41709-5ace-4042-841a-987b52962085 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:14.302318 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a5e9407f-c652-4128-b3f3-9a423bdeb076 req-070b642c-4e95-4155-8957-7d99ac0f0237 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 932 time: 0.5734959 Sep 16 16:22:14.412607 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-cff41709-5ace-4042-841a-987b52962085 None None] Port 21f70636-78ad-426a-af75-45688a14aabf cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:22:14.440496 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a5e9407f-c652-4128-b3f3-9a423bdeb076 req-90d84b94-5fb0-4f5f-8037-8db94b66677a tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014693 Sep 16 16:22:14.605926 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device ed36e85b-3ccd-4d09-afaa-2def955b8b7c up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:14.784546 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port ed36e85b-3ccd-4d09-afaa-2def955b8b7c triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:14.785421 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:14.955819 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Allocated IP 172.20.0.4 (143ad357-dcc1-47a6-a228-62d36164e62c/57a636e1-0951-4c2f-8be2-8ca36acb1d05/2f6c8a4f-a8c2-4261-b743-89b4b84383d3) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:15.072184 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.199167 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port ed36e85b-3ccd-4d09-afaa-2def955b8b7c, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:15.220407 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.222358 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.254740 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-85c15bb6-9210-4c33-9056-f2302aea87e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.406744 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:15.490830 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-85c15bb6-9210-4c33-9056-f2302aea87e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.501510 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67d56d0-6e58-4d7c-9d55-bdfbe599bc93 req-14147af9-8d43-4da9-95e4-63297726b308 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.5841217 Sep 16 16:22:15.515001 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-85c15bb6-9210-4c33-9056-f2302aea87e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.584168 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-1c5d0110-c59b-45a5-8557-fab27baff2bb tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:15.593546 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-1c5d0110-c59b-45a5-8557-fab27baff2bb tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 818 time: 0.5725045 Sep 16 16:22:15.630637 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-8147fe60-3eea-4749-bcd4-96a3dac1adda tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/quotas/edfe8167ea8b4027bb39f6b5ad4d2c57 HTTP/1.1" status: 200 len: 375 time: 0.0247540 Sep 16 16:22:15.663898 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device ed36e85b-3ccd-4d09-afaa-2def955b8b7c up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:15.697329 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:22:15.738366 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-70fa8941-69f0-44a4-a6a5-62c9ff96c663 admin admin] 10.222.0.59 "PUT /v2.0/routers/da1aab41-d805-4a4f-a252-59e579ace211/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2136493 Sep 16 16:22:15.741059 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-85c15bb6-9210-4c33-9056-f2302aea87e1 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c6faf520fd754893abd28b26a7beb4b7&name=default HTTP/1.1" status: 200 len: 2975 time: 1.5551066 Sep 16 16:22:15.745735 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34582) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:15.748332 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c15bb6-9210-4c33-9056-f2302aea87e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb9c5f94-2587-4db3-a8c7-c3270cf073ff,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:15.776388 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:15.782264 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:22:15.829822 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-da62815c-4f90-4b9a-b504-7c3a73448088 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1890500 Sep 16 16:22:15.846189 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.66', 56945) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:15.858774 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:15.859941 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:16.037047 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port ed36e85b-3ccd-4d09-afaa-2def955b8b7c triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:16.037948 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.082661 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-017e366d-6c1f-43f1-9ef7-b3902648db75 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.087184 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-af42863a-5d01-4983-b0cb-bf6a3799d93b service neutron] 10.222.0.59 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2430992 Sep 16 16:22:16.206443 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-017e366d-6c1f-43f1-9ef7-b3902648db75 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.293198 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e23a376e-556e-4737-ada1-f038ddbcf060 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:16.308328 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.315332 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-017e366d-6c1f-43f1-9ef7-b3902648db75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.322938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-017e366d-6c1f-43f1-9ef7-b3902648db75 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.324567 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-017e366d-6c1f-43f1-9ef7-b3902648db75 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/cb9c5f94-2587-4db3-a8c7-c3270cf073ff HTTP/1.1" status: 204 len: 168 time: 0.5776882 Sep 16 16:22:16.345505 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-017e366d-6c1f-43f1-9ef7-b3902648db75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb9c5f94-2587-4db3-a8c7-c3270cf073ff,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:16.410231 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Transition to ACTIVE for port object e23a376e-556e-4737-ada1-f038ddbcf060 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:22:16.419408 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.474197 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:16.500710 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9a9ff9-af2b-44e2-9efa-047d6db3ff64 req-d2108823-9b70-4266-b6fa-25313e9823d3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:16.502632 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb9a9ff9-af2b-44e2-9efa-047d6db3ff64 req-d2108823-9b70-4266-b6fa-25313e9823d3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 932 time: 0.1393957 Sep 16 16:22:16.526153 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.653117 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Pushing event updated for resources: {'Port': ['ID=e23a376e-556e-4737-ada1-f038ddbcf060,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:16.667044 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb9a9ff9-af2b-44e2-9efa-047d6db3ff64 req-a72af84e-ef78-4aab-9ff4-ca5e849778b3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1529105 Sep 16 16:22:16.675262 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Attempting to bind port e23a376e-556e-4737-ada1-f038ddbcf060 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:16.675711 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Attempting to bind port e23a376e-556e-4737-ada1-f038ddbcf060 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '6f8c7cc7-81db-4318-8cb5-16b891d859e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 731, 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:16.676896 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Attempting to bind port e23a376e-556e-4737-ada1-f038ddbcf060 on network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:16.685680 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Port e23a376e-556e-4737-ada1-f038ddbcf060 on network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:22:16.687186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Attempting to bind port e23a376e-556e-4737-ada1-f038ddbcf060 on network b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:16.696581 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:16.697434 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Checking segment: {'id': '6f8c7cc7-81db-4318-8cb5-16b891d859e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 731, 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:16.698181 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Bound using segment: {'id': '6f8c7cc7-81db-4318-8cb5-16b891d859e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 731, 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:16.698775 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Bound port: e23a376e-556e-4737-ada1-f038ddbcf060, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f8c7cc7-81db-4318-8cb5-16b891d859e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 731, 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:16.699284 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.866994 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] For port e23a376e-556e-4737-ada1-f038ddbcf060, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:16.877118 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] For port e23a376e-556e-4737-ada1-f038ddbcf060, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e23a376e-556e-4737-ada1-f038ddbcf060,segment=NetworkSegment(6f8c7cc7-81db-4318-8cb5-16b891d859e6),segment_id=6f8c7cc7-81db-4318-8cb5-16b891d859e6)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:16.884903 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Network 143ad357-dcc1-47a6-a228-62d36164e62c is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:16.889212 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.916246 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:16.968146 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:16.969366 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:16.971076 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] 10.222.0.66 "PUT /v2.0/ports/e23a376e-556e-4737-ada1-f038ddbcf060 HTTP/1.1" status: 200 len: 1094 time: 3.8590882 Sep 16 16:22:16.971591 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '68798125-7e39-4c0b-807d-f17667e701f2', 'tag': 'e23a376e-556e-4737-ada1-f038ddbcf060'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:17.005737 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:17.058309 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-c9ce5ee5-0419-4965-8127-83d6a4c7e012 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:17.059945 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-c9ce5ee5-0419-4965-8127-83d6a4c7e012 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 818 time: 0.9754198 Sep 16 16:22:17.089351 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d30d7c6f-d9c0-413c-a1bb-80caffce47f5 service neutron] 10.222.0.59 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9837105 Sep 16 16:22:17.096854 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Request body: {'port': {'device_id': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'admin_state_up': True, 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:17.104234 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event updated for resources: {'Port': ['ID=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:17.232832 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:17.233545 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:17.259632 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2fd8ff-264d-48b5-aa37-e14b6a5a2baf service neutron] Pushing event updated for resources: {'Port': ['ID=e23a376e-556e-4737-ada1-f038ddbcf060,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:17.342717 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-2c49084a-770d-4d88-8fb9-6f3534bc23f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:17.342717 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-2c49084a-770d-4d88-8fb9-6f3534bc23f0 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8142a9d3002f4b6d8aa31c635da07520&device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 1097 time: 0.2667906 Sep 16 16:22:17.450031 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-288267d3-d6cd-4c71-8aa5-bbebd0516664 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.5375385 Sep 16 16:22:17.482151 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Request body: {'port': {'device_id': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:17.514611 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 2, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:17.592682 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:22:17.597542 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Updating router da1aab41-d805-4a4f-a252-59e579ace211 port 21f70636-78ad-426a-af75-45688a14aabf binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:22:17.618648 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-4daa7c30-51b7-4d71-89b7-6e144f6e474c service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e23a376e-556e-4737-ada1-f038ddbcf060 HTTP/1.1" status: 200 len: 217 time: 0.2350886 Sep 16 16:22:17.621469 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34656) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:17.688765 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:17.750285 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:17.876164 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84014691-b89d-4304-a85a-7d5325fe8677" -d '{"events": [{"name": "network-changed", "server_uuid": "68798125-7e39-4c0b-807d-f17667e701f2", "tag": "e23a376e-556e-4737-ada1-f038ddbcf060"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:17.905788 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-1e52b280-47e0-4cd5-a4ab-a15a75261678 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:17.910816 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-1e52b280-47e0-4cd5-a4ab-a15a75261678 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=e4933948-8e0f-4ede-a776-0bbd1e3c2a6c HTTP/1.1" status: 200 len: 852 time: 0.2618539 Sep 16 16:22:18.138504 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2de8c2-074b-4ebf-8fb9-841ac298da7f req-a65d9ee6-3f83-40ce-a6bd-0d49fb020b93 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:18.146588 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9b2de8c2-074b-4ebf-8fb9-841ac298da7f req-a65d9ee6-3f83-40ce-a6bd-0d49fb020b93 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 931 time: 0.2685194 Sep 16 16:22:18.195949 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Made reservation on behalf of edfe8167ea8b4027bb39f6b5ad4d2c57 for: {'port': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:18.200935 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:18.233754 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-aa83f680-5da6-46a8-a55d-80eb62860b16 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3065352 Sep 16 16:22:18.251379 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e302442b-2719-4fc9-b9be-c39f0e043c43 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:18.487443 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34684) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:18.514243 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'security_group': {'name': 'tempest-securitygroup--249887605', 'description': 'tempest-description--1885607407'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:18.533714 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:18.541951 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:18.601343 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9b2de8c2-074b-4ebf-8fb9-841ac298da7f req-a9625cfb-e189-4789-92f6-979b38744093 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4501216 Sep 16 16:22:18.659611 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d254826b-1307-4ed7-a26a-186377c5515c req-7f5fe94d-f2e8-4175-b506-b021c5129e98 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 210 time: 0.0808361 Sep 16 16:22:18.730551 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-9d934f37-a31a-4e32-a40a-302414847f26 service neutron] 10.222.0.66 "GET /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4751019 Sep 16 16:22:18.807017 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Attempting to bind port 21f70636-78ad-426a-af75-45688a14aabf on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:18.807660 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Attempting to bind port 21f70636-78ad-426a-af75-45688a14aabf by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:18.808369 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Attempting to bind port 21f70636-78ad-426a-af75-45688a14aabf on network baca97e8-c07b-484a-a0fa-c440a2abcfed {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:18.813991 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c70fd891-02a0-4be0-a150-f36c8821e486 None None] Pushing event updated for resources: {'Port': ['ID=21f70636-78ad-426a-af75-45688a14aabf,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:18.826065 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 21, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:18.828405 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Checking segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:18.829623 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:18.831307 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Bound using segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:18.831945 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Bound port: 21f70636-78ad-426a-af75-45688a14aabf, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:18.832518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.024375 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] For port 21f70636-78ad-426a-af75-45688a14aabf, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:19.049215 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] For port 21f70636-78ad-426a-af75-45688a14aabf, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=21f70636-78ad-426a-af75-45688a14aabf,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:19.057209 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.070691 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e302442b-2719-4fc9-b9be-c39f0e043c43 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.107951 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e302442b-2719-4fc9-b9be-c39f0e043c43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.173360 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Allocated IP 172.20.0.3 (53267936-cd43-4d76-85cb-9474bc332b78/c1936e4e-27dd-43b2-be4a-1bdf226e79cc/e42ecb5c-bf82-4da7-a301-2a3b2912db3d) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:19.220140 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c70fd891-02a0-4be0-a150-f36c8821e486 None None] Pushing event updated for resources: {'Port': ['ID=21f70636-78ad-426a-af75-45688a14aabf,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:19.276584 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-e448a07c-0b80-4638-8cbd-ea2348ed5761 None None] Provisioning complete for port 21f70636-78ad-426a-af75-45688a14aabf triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:19.277004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e448a07c-0b80-4638-8cbd-ea2348ed5761 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.277318 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 {{(pid=93950) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:19.285639 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.300773 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.329319 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.provisioning_blocks [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Transition to ACTIVE for port object 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 will not be triggered until provisioned by entity L2. {{(pid=93950) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:22:19.339442 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:19.386634 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71772fb-da78-4758-a2e5-1d253d634616 req-69a9827c-b6bb-47ba-928d-81b667987bfa tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:19.388334 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e71772fb-da78-4758-a2e5-1d253d634616 req-69a9827c-b6bb-47ba-928d-81b667987bfa tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.5360434 Sep 16 16:22:19.445436 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-453ea729-1df1-4c65-b1a8-793bb248f3d4 req-cbc69d2e-0119-490e-a8a1-b3d427ba4075 service neutron] 10.222.0.66 "GET /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6933098 Sep 16 16:22:19.456054 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:19.456681 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:21:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:19.512959 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e302442b-2719-4fc9-b9be-c39f0e043c43 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=2fdb808e43304ee79db2ee725c2ca7d9&name=default HTTP/1.1" status: 200 len: 2975 time: 1.8740363 Sep 16 16:22:19.532987 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34714) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:19.542936 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Pushing event updated for resources: {'Port': ['ID=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:19.560838 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a06497b-c36c-4758-899b-58dd5d8acc12 x-openstack-request-id: req-9a06497b-c36c-4758-899b-58dd5d8acc12 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:19.561130 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "68798125-7e39-4c0b-807d-f17667e701f2", "tag": "e23a376e-556e-4737-ada1-f038ddbcf060", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:19.570974 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-9a06497b-c36c-4758-899b-58dd5d8acc12 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:19.575999 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '68798125-7e39-4c0b-807d-f17667e701f2', 'tag': 'e23a376e-556e-4737-ada1-f038ddbcf060', 'status': 'completed', 'code': 200} Sep 16 16:22:19.578838 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.66', 56951) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:19.703094 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e302442b-2719-4fc9-b9be-c39f0e043c43 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e60df4cb-93a3-4854-9ac1-12643acb0f13,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:19.848730 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:19.975891 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.002007 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84014691-b89d-4304-a85a-7d5325fe8677 req-68ce7b1a-951c-4fb9-8f54-4e42871cd4de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:20.006079 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-68ce7b1a-951c-4fb9-8f54-4e42871cd4de service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8142a9d3002f4b6d8aa31c635da07520&device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 1097 time: 0.2957575 Sep 16 16:22:20.021018 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e71772fb-da78-4758-a2e5-1d253d634616 req-7bd76415-f3c8-424c-9ec3-dcb8db5656a8 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5743239 Sep 16 16:22:20.072856 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.100428 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4ef960ad-4aba-46c5-9709-b07c0be68df1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.126616 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4ef960ad-4aba-46c5-9709-b07c0be68df1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.151511 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Attempting to bind port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:20.151881 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Attempting to bind port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:20.152231 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Attempting to bind port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:20.213921 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.224448 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 on network 143ad357-dcc1-47a6-a228-62d36164e62c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:22:20.224898 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Attempting to bind port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:20.263008 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:20.263306 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Checking segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:20.263906 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Bound using segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:20.265854 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Bound port: 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:20.267129 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.291062 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a35ea1a4-42a6-4e95-821b-d662c756858f,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:20.293802 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.295336 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0a3335e7-9698-4128-837b-e5f8eadfb21d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 1.8007178 Sep 16 16:22:20.300640 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4ef960ad-4aba-46c5-9709-b07c0be68df1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.306568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4ef960ad-4aba-46c5-9709-b07c0be68df1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.307969 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-4ef960ad-4aba-46c5-9709-b07c0be68df1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e60df4cb-93a3-4854-9ac1-12643acb0f13 HTTP/1.1" status: 204 len: 168 time: 0.7534611 Sep 16 16:22:20.309125 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34748) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:20.369885 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'security_group_rule': {'security_group_id': 'a35ea1a4-42a6-4e95-821b-d662c756858f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:20.396420 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef960ad-4aba-46c5-9709-b07c0be68df1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e60df4cb-93a3-4854-9ac1-12643acb0f13,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:20.465943 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc62aea-c6f7-4380-b775-4bdacab4826f req-2b5198d7-5ac2-4bc5-9172-ad8346c1fec4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:20.469757 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1cc62aea-c6f7-4380-b775-4bdacab4826f req-2b5198d7-5ac2-4bc5-9172-ad8346c1fec4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.2151604 Sep 16 16:22:20.472937 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.490345 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e448a07c-0b80-4638-8cbd-ea2348ed5761 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.491013 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6eedc92b-596a-47d4-bc75-5cab7f7ad71b req-f9d4f2c3-2e51-4bca-ab61-70181644a954 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 210 time: 0.1516147 Sep 16 16:22:20.672578 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-e448a07c-0b80-4638-8cbd-ea2348ed5761 None None] For port 21f70636-78ad-426a-af75-45688a14aabf, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=21f70636-78ad-426a-af75-45688a14aabf,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:20.706184 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e448a07c-0b80-4638-8cbd-ea2348ed5761 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.732998 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.764462 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.846953 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04041c69-6a85-4202-98db-543b6cdbe4a2,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:20.870655 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e448a07c-0b80-4638-8cbd-ea2348ed5761 None None] Pushing event updated for resources: {'Port': ['ID=21f70636-78ad-426a-af75-45688a14aabf,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:20.886748 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-ff5b4fe7-7929-4be3-bce1-34a67fe657a2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:20.898254 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-ff5b4fe7-7929-4be3-bce1-34a67fe657a2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 818 time: 1.3566654 Sep 16 16:22:20.917076 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] For port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host hv-cinder-80588, cleared binding levels {{(pid=93950) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:20.923104 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] For port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93950) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:20.939042 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:20.950707 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-0f07650d-19fb-48af-bc1a-bde95cb02205 None None] Provisioning complete for port 21f70636-78ad-426a-af75-45688a14aabf triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:20.956841 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0f07650d-19fb-48af-bc1a-bde95cb02205 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.002650 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1cc62aea-c6f7-4380-b775-4bdacab4826f req-2724c2c3-8e70-4b04-841b-243b38bbc130 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4154184 Sep 16 16:22:21.005293 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.033140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:21.033843 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.035512 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.036335 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] 10.222.0.66 "PUT /v2.0/ports/2f6c8a4f-a8c2-4261-b743-89b4b84383d3 HTTP/1.1" status: 200 len: 1093 time: 3.5787227 Sep 16 16:22:21.037947 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0164ffa0-8e77-42c9-be65-1145384950d1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6785457 Sep 16 16:22:21.041299 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34774) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:21.045996 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Network 53267936-cd43-4d76-85cb-9474bc332b78 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:21.049516 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'tag': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:21.055104 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'security_group_rule': {'security_group_id': 'a35ea1a4-42a6-4e95-821b-d662c756858f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:21.059344 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:21.067931 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84014691-b89d-4304-a85a-7d5325fe8677 req-20314c66-9d69-4c27-8f7f-867dd2e3e42c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:21.069789 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-20314c66-9d69-4c27-8f7f-867dd2e3e42c service neutron] 10.222.0.66 "GET /v2.0/networks?id=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 HTTP/1.1" status: 200 len: 913 time: 1.0268443 Sep 16 16:22:21.077633 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:21.178801 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Request body: {'port': {'device_id': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'admin_state_up': True, 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:21.199423 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4b52c13f-dd49-4fe9-a047-8d43fd00fd0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.238100 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.301324 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34786) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:21.321221 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b0da6b8a-08e5-4318-a6d1-5dc292877be8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.341637 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:19Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:21.369587 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7116bcd8-b010-4dac-b5b5-179b19fcc649 service neutron] Pushing event updated for resources: {'Port': ['ID=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,revision_number=3']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:21.371703 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.400548 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff655991-97e9-40a5-8811-cc0fd85dcabb None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:19Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:22:21.406968 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.493309 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f1206aaf-9019-475b-b1b7-52eda8873de8,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:21.647639 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2" -d '{"events": [{"name": "network-changed", "server_uuid": "2c827e7d-de34-4f39-9e3e-62e6bc0c387c", "tag": "2f6c8a4f-a8c2-4261-b743-89b4b84383d3"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:21.735697 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-ce70a306-a1b3-41b5-a93a-4edce246e510 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e23a376e-556e-4737-ada1-f038ddbcf060 HTTP/1.1" status: 200 len: 217 time: 0.5296113 Sep 16 16:22:21.791339 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:21.792046 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:21.849972 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 21f70636-78ad-426a-af75-45688a14aabf up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:21.850217 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-efd305eb-0baa-40b8-8540-cc9347aefc92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:21.851851 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-efd305eb-0baa-40b8-8540-cc9347aefc92 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 1096 time: 0.6105521 Sep 16 16:22:21.858173 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Pushing event updated for resources: {'Port': ['ID=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:21.869214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e07fdc-c1ca-4084-a53e-4a5e0378bd70 req-d9f08ba4-1871-449d-b759-25fe7334ea26 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:21.870947 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d5e07fdc-c1ca-4084-a53e-4a5e0378bd70 req-d9f08ba4-1871-449d-b759-25fe7334ea26 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.3437903 Sep 16 16:22:21.968413 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-384b40c0-2bcc-424f-8391-c545b397c5c6 req-1b706c63-2910-4d69-894e-4455c04f4be1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 210 time: 0.1061218 Sep 16 16:22:21.994809 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b0da6b8a-08e5-4318-a6d1-5dc292877be8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.017290 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b0da6b8a-08e5-4318-a6d1-5dc292877be8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.037846 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.049008 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-006d890b-3e37-4417-802b-3b3a5a1f5a6c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0034950 Sep 16 16:22:22.055641 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 21f70636-78ad-426a-af75-45688a14aabf triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:22.056214 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.056732 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:22:22.076508 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-38a18e4e-982b-4085-894d-c7e047f0e65b service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3 HTTP/1.1" status: 200 len: 217 time: 0.1964433 Sep 16 16:22:22.083858 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34812) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:22.102179 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d5e07fdc-c1ca-4084-a53e-4a5e0378bd70 req-db526adc-f496-42ec-8d5e-553ee6155339 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693657 Sep 16 16:22:22.117347 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e4f4bf6f-f223-47d4-928a-57bb891564f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.0329490 Sep 16 16:22:22.121447 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84014691-b89d-4304-a85a-7d5325fe8677 req-7c257f92-cec5-452a-b3eb-0006656723a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:22.123975 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-7c257f92-cec5-452a-b3eb-0006656723a8 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=e4933948-8e0f-4ede-a776-0bbd1e3c2a6c HTTP/1.1" status: 200 len: 852 time: 0.3735104 Sep 16 16:22:22.190019 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34814) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:22.218855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:22.236163 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Request body: {'port': {'device_id': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:22.273479 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Made reservation on behalf of edfe8167ea8b4027bb39f6b5ad4d2c57 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:22.279803 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.409152 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-b0da6b8a-08e5-4318-a6d1-5dc292877be8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=9672a928b2c34f05b9c2548adb18e995&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1056552 Sep 16 16:22:22.418824 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34820) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:22.478988 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0da6b8a-08e5-4318-a6d1-5dc292877be8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3354c6e0-fe05-42b4-88fe-9fbc1a5d61ff,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:22.584587 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29d4eb97-55b8-4720-99ed-05e5bfca60df x-openstack-request-id: req-29d4eb97-55b8-4720-99ed-05e5bfca60df {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:22.585168 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c827e7d-de34-4f39-9e3e-62e6bc0c387c", "tag": "2f6c8a4f-a8c2-4261-b743-89b4b84383d3", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:22.585168 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-29d4eb97-55b8-4720-99ed-05e5bfca60df {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:22.589841 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'tag': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'status': 'completed', 'code': 200} Sep 16 16:22:22.616136 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.652235 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-e27e42a8-a454-4cfa-9b4a-aa9c6f2ec956 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3552244 Sep 16 16:22:22.666620 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-61683cf4-e9d7-4bf4-9390-1c750ffdf86a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.723873 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:22.762309 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-ee1088da-07a5-4020-8f36-1a105842ef2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:22.763837 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-ee1088da-07a5-4020-8f36-1a105842ef2e service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.6661260 Sep 16 16:22:22.775607 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb3a561-119a-451d-ab44-213ac13a414c req-66ebba7d-cc05-4593-809d-b65f7adf0ea8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:22.777473 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1eb3a561-119a-451d-ab44-213ac13a414c req-66ebba7d-cc05-4593-809d-b65f7adf0ea8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.3195696 Sep 16 16:22:22.865735 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1eb3a561-119a-451d-ab44-213ac13a414c req-253de4a9-ca78-4748-8f0c-2c287e7e4202 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785005 Sep 16 16:22:22.966076 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cc84be2e-2ad8-43c2-9795-5b11c1df48f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.014052 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Allocated IP 172.20.0.13 (53267936-cd43-4d76-85cb-9474bc332b78/c1936e4e-27dd-43b2-be4a-1bdf226e79cc/4056f695-287f-45f7-bd60-21b6a8421280) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:23.021135 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-61683cf4-e9d7-4bf4-9390-1c750ffdf86a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.047677 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-61683cf4-e9d7-4bf4-9390-1c750ffdf86a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.052467 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cc84be2e-2ad8-43c2-9795-5b11c1df48f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.212876 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34836) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:23.220040 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-61683cf4-e9d7-4bf4-9390-1c750ffdf86a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=85df720bde7a44d596d8f19ad42e828b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9696646 Sep 16 16:22:23.225163 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61683cf4-e9d7-4bf4-9390-1c750ffdf86a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77c91c06-a4a2-43df-82a2-c5735c170cbc,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:23.300487 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6361b07b-e1bd-4bce-9a7d-1c90a3bef0c1 req-cc499e95-0088-42f6-bc65-18da359c5df9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 210 time: 0.1836624 Sep 16 16:22:23.388682 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.464591 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f0c52621-a94a-4f8a-9605-ba39a0efb533 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.465215 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a850f8c8-a898-4ebb-96b1-bdaff8284c60 req-4f29b827-a034-4d70-a420-67df5c46ad75 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:23.469538 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a850f8c8-a898-4ebb-96b1-bdaff8284c60 req-4f29b827-a034-4d70-a420-67df5c46ad75 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.2585528 Sep 16 16:22:23.521004 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1f290fb-fe11-49cd-84ae-e25c568655ca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.549565 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1f290fb-fe11-49cd-84ae-e25c568655ca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.624108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1f290fb-fe11-49cd-84ae-e25c568655ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.632943 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1f290fb-fe11-49cd-84ae-e25c568655ca admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.637765 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-f1f290fb-fe11-49cd-84ae-e25c568655ca admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/77c91c06-a4a2-43df-82a2-c5735c170cbc HTTP/1.1" status: 204 len: 168 time: 0.4213264 Sep 16 16:22:23.705718 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f290fb-fe11-49cd-84ae-e25c568655ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77c91c06-a4a2-43df-82a2-c5735c170cbc,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:23.726628 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a850f8c8-a898-4ebb-96b1-bdaff8284c60 req-e1a69521-fd69-4678-95ec-3e7f3f87af04 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2479894 Sep 16 16:22:23.740400 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Allocated IP 172.27.3.73 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/12bc727a-6c27-468c-a7c8-5d7247350d36) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:23.752683 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.769170 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cc84be2e-2ad8-43c2-9795-5b11c1df48f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.772089 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cc84be2e-2ad8-43c2-9795-5b11c1df48f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:23.775634 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-cc84be2e-2ad8-43c2-9795-5b11c1df48f5 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/3354c6e0-fe05-42b4-88fe-9fbc1a5d61ff HTTP/1.1" status: 204 len: 168 time: 1.3239462 Sep 16 16:22:23.793473 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc84be2e-2ad8-43c2-9795-5b11c1df48f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3354c6e0-fe05-42b4-88fe-9fbc1a5d61ff,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:23.944720 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.083193 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.105250 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.338889 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb16e458-51b0-4e98-97bb-4fac8635d89e req-1c432f42-e231-4a82-8866-6c75a0b3cb97 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:24.355706 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cb16e458-51b0-4e98-97bb-4fac8635d89e req-1c432f42-e231-4a82-8866-6c75a0b3cb97 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.3422005 Sep 16 16:22:24.356463 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.379405 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34872) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:24.402216 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-450aac20-34a6-410a-9449-a4b042eaf690 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.449309 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:24.461114 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:24.476271 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:24.499374 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'Port': ['ID=12bc727a-6c27-468c-a7c8-5d7247350d36,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:24.538333 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cb16e458-51b0-4e98-97bb-4fac8635d89e req-47b47b7f-c9ba-4a21-9c18-56b1a6cf8db7 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1798475 Sep 16 16:22:24.553188 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-481adcc6-06bb-4296-bd32-5cb660d7e1b6 req-6f467f7f-bc14-4d71-ab97-7322f3d11cf0 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 210 time: 0.1072671 Sep 16 16:22:24.579300 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.653804 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34880) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:24.686161 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.736310 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Network 53267936-cd43-4d76-85cb-9474bc332b78 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:24.746209 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:24.752128 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.754495 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:24.760434 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:24.761066 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.764510 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Pushing event updated for resources: {'Port': ['ID=4056f695-287f-45f7-bd60-21b6a8421280,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:24.835653 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-450aac20-34a6-410a-9449-a4b042eaf690 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.845654 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-450aac20-34a6-410a-9449-a4b042eaf690 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.865622 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-816d512c-2352-42bf-ae8d-a5e5d41be559 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.7267075 Sep 16 16:22:24.937039 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-450aac20-34a6-410a-9449-a4b042eaf690 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a020428cfae9431b9ac372d63e3e370c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5558510 Sep 16 16:22:24.939454 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450aac20-34a6-410a-9449-a4b042eaf690 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab106141-f78c-4f77-b8a8-f914d4311bc2,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:24.941855 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 34888) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:24.956886 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e42ecb5c-bf82-4da7-a301-2a3b2912db3d {{(pid=93950) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:24.972903 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:24.999842 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.provisioning_blocks [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Transition to ACTIVE for port object e42ecb5c-bf82-4da7-a301-2a3b2912db3d will not be triggered until provisioned by entity L2. {{(pid=93950) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:22:25.009668 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.083878 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb4c9b1a-95da-453a-a84a-320b0180ac2f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.107049 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb4c9b1a-95da-453a-a84a-320b0180ac2f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.178021 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Pushing event updated for resources: {'Port': ['ID=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:25.193471 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79c751de-c224-4e3e-ba22-e6fe5f4e3974 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.213870 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb4c9b1a-95da-453a-a84a-320b0180ac2f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.225665 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb4c9b1a-95da-453a-a84a-320b0180ac2f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.226860 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-cb4c9b1a-95da-453a-a84a-320b0180ac2f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/ab106141-f78c-4f77-b8a8-f914d4311bc2 HTTP/1.1" status: 204 len: 168 time: 0.2819245 Sep 16 16:22:25.252675 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4c9b1a-95da-453a-a84a-320b0180ac2f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab106141-f78c-4f77-b8a8-f914d4311bc2,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:25.304907 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Attempting to bind port e42ecb5c-bf82-4da7-a301-2a3b2912db3d on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:25.305254 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Attempting to bind port e42ecb5c-bf82-4da7-a301-2a3b2912db3d by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:25.306131 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Attempting to bind port e42ecb5c-bf82-4da7-a301-2a3b2912db3d on network 53267936-cd43-4d76-85cb-9474bc332b78 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:25.318186 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Port e42ecb5c-bf82-4da7-a301-2a3b2912db3d on network 53267936-cd43-4d76-85cb-9474bc332b78 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:22:25.318551 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Attempting to bind port e42ecb5c-bf82-4da7-a301-2a3b2912db3d on network 53267936-cd43-4d76-85cb-9474bc332b78 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:25.330273 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:25.330925 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Checking segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:25.331033 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Bound using segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:25.331640 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Bound port: e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'}}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:25.331999 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.334166 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41499d03-1f39-4663-9b1c-d27924900b77 req-31e292b3-9ee4-449a-8d45-5e61df0f7458 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:25.356074 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-41499d03-1f39-4663-9b1c-d27924900b77 req-31e292b3-9ee4-449a-8d45-5e61df0f7458 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.4517217 Sep 16 16:22:25.441175 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] For port e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host hv-cinder-80588, cleared binding levels {{(pid=93950) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:25.445761 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] For port e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93950) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:25.462391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.466844 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-41499d03-1f39-4663-9b1c-d27924900b77 req-48e8c2d6-d561-4273-b9c3-4f900961278b tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042645 Sep 16 16:22:25.504995 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.527732 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.552600 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79c751de-c224-4e3e-ba22-e6fe5f4e3974 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.561308 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:25.561690 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.563547 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] 10.222.0.66 "PUT /v2.0/ports/e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 1093 time: 3.3425190 Sep 16 16:22:25.563890 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'tag': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:25.566435 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-317a207e-6d1d-43f6-ab51-5848749af3ce" -d '{"events": [{"name": "network-changed", "server_uuid": "4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d", "tag": "e42ecb5c-bf82-4da7-a301-2a3b2912db3d"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:25.594924 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.610770 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-79c751de-c224-4e3e-ba22-e6fe5f4e3974 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.621842 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.632236 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.4730818 Sep 16 16:22:25.652270 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c515c60a-d46b-4e97-9fb3-a4931d4264a3 x-openstack-request-id: req-c515c60a-d46b-4e97-9fb3-a4931d4264a3 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:25.652585 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d", "tag": "e42ecb5c-bf82-4da7-a301-2a3b2912db3d", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:25.652822 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-c515c60a-d46b-4e97-9fb3-a4931d4264a3 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:25.653203 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'tag': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d', 'status': 'completed', 'code': 200} Sep 16 16:22:25.654325 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0feec2fc-92e2-45c5-96c4-ba086085ef13 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'Port': ['ID=12bc727a-6c27-468c-a7c8-5d7247350d36,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:25.774981 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0958a1-b812-45a6-ab69-eb626aa7dd15 req-deac2beb-bec0-4e00-bf79-33bc554dd6b6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:25.776868 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1f0958a1-b812-45a6-ab69-eb626aa7dd15 req-deac2beb-bec0-4e00-bf79-33bc554dd6b6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 932 time: 0.0677853 Sep 16 16:22:25.788149 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-79c751de-c224-4e3e-ba22-e6fe5f4e3974 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=529126b6f696433581550dd963951c44&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0994289 Sep 16 16:22:25.789541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 34926) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:25.793588 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c751de-c224-4e3e-ba22-e6fe5f4e3974 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=082e73b8-22cd-4944-9eb3-a5d770f4d893,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:25.818179 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36cc73e4-598c-4112-ba53-e79f83b5c4ce service neutron] Pushing event updated for resources: {'Port': ['ID=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,revision_number=3']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:25.837035 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9a1a03-3624-42c7-bace-9e0ba1f9cee1 req-ed3d9d6f-3c3f-4b76-8c90-21dd5bad0b5a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:25.838571 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0a9a1a03-3624-42c7-bace-9e0ba1f9cee1 req-ed3d9d6f-3c3f-4b76-8c90-21dd5bad0b5a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.1661577 Sep 16 16:22:25.856823 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1f0958a1-b812-45a6-ab69-eb626aa7dd15 req-73774844-a352-4e0a-9855-c98003010922 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733836 Sep 16 16:22:25.874499 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bf08a018-277a-47ba-804e-81c28b3c34a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.905952 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bf08a018-277a-47ba-804e-81c28b3c34a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:25.922507 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0a9a1a03-3624-42c7-bace-9e0ba1f9cee1 req-ee342f38-089f-4943-87ae-11d1a6d4eb9b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763001 Sep 16 16:22:26.015263 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-30d0920d-2622-4b37-b655-d6f699891849 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--249887605&fields=id&tenant_id=36186b0d094344dbb7b6d93645ae77e1 HTTP/1.1" status: 200 len: 267 time: 0.0468349 Sep 16 16:22:26.020439 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bf08a018-277a-47ba-804e-81c28b3c34a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:26.023474 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bf08a018-277a-47ba-804e-81c28b3c34a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:26.027686 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-bf08a018-277a-47ba-804e-81c28b3c34a4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/082e73b8-22cd-4944-9eb3-a5d770f4d893 HTTP/1.1" status: 204 len: 168 time: 0.2354445 Sep 16 16:22:26.048888 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf08a018-277a-47ba-804e-81c28b3c34a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=082e73b8-22cd-4944-9eb3-a5d770f4d893,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:26.180667 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-18369f6c-d277-4808-a645-2bca0c92b6a9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:26.181661 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:26.193555 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-18369f6c-d277-4808-a645-2bca0c92b6a9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 810 time: 0.1645858 Sep 16 16:22:26.207999 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Request body: {'port': {'device_id': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:26.229666 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-279a67c4-acc5-485c-862c-a20fb9944ea0 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0454957 Sep 16 16:22:26.253675 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-0259cb5e-9e27-451a-886d-7c6be44b9509 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/quotas/36186b0d094344dbb7b6d93645ae77e1 HTTP/1.1" status: 200 len: 375 time: 0.0389411 Sep 16 16:22:26.312647 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-3ca5496e-6519-4f9b-ad0f-369251e846e8 service neutron] 10.222.0.66 "GET /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1191051 Sep 16 16:22:26.333746 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-a02cad79-5145-42b0-ba05-10914bb26af2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0762863 Sep 16 16:22:26.334397 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:26.600723 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-a0abbf04-36d1-4b6c-92c8-147d70ba2205 service neutron] 10.222.0.59 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2247682 Sep 16 16:22:26.770798 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-58bdfa4a-92ca-45c2-abd2-4d5e8df66553 service neutron] 10.222.0.59 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1603677 Sep 16 16:22:26.841202 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4056f695-287f-45f7-bd60-21b6a8421280 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:26.849696 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:26.857774 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-9772dc47-9d02-4a08-97fa-f35464e0ee5f service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4925900 Sep 16 16:22:26.864661 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317a207e-6d1d-43f6-ab51-5848749af3ce req-952527be-29e5-426d-b3c5-a82f678d1bda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:26.864661 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-317a207e-6d1d-43f6-ab51-5848749af3ce req-952527be-29e5-426d-b3c5-a82f678d1bda service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1096 time: 0.5514011 Sep 16 16:22:26.879975 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Transition to ACTIVE for port object 4056f695-287f-45f7-bd60-21b6a8421280 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:22:26.887817 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:27.044095 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Attempting to bind port 4056f695-287f-45f7-bd60-21b6a8421280 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:27.044669 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Attempting to bind port 4056f695-287f-45f7-bd60-21b6a8421280 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:27.049621 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Attempting to bind port 4056f695-287f-45f7-bd60-21b6a8421280 on network 53267936-cd43-4d76-85cb-9474bc332b78 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:27.053507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Pushing event updated for resources: {'Port': ['ID=4056f695-287f-45f7-bd60-21b6a8421280,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:27.061045 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Port 4056f695-287f-45f7-bd60-21b6a8421280 on network 53267936-cd43-4d76-85cb-9474bc332b78 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:22:27.061392 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Attempting to bind port 4056f695-287f-45f7-bd60-21b6a8421280 on network 53267936-cd43-4d76-85cb-9474bc332b78 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:27.067940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:27.068276 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Checking segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:27.068648 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Bound using segment: {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:27.069281 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Bound port: 4056f695-287f-45f7-bd60-21b6a8421280, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 721, 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:27.069859 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:27.266338 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-ad551261-2a82-4e8d-9f99-6e5142a0480c service neutron] 10.222.0.66 "GET /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8931553 Sep 16 16:22:27.283962 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] For port 4056f695-287f-45f7-bd60-21b6a8421280, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:27.297495 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b35faf20-f24b-421f-990f-568547d5b9fb req-98c52418-550d-40b3-8668-680d0bb867b3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.299532 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b35faf20-f24b-421f-990f-568547d5b9fb req-98c52418-550d-40b3-8668-680d0bb867b3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.4387875 Sep 16 16:22:27.307334 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] For port 4056f695-287f-45f7-bd60-21b6a8421280, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=4056f695-287f-45f7-bd60-21b6a8421280,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:27.324653 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97089289-9246-4506-82fe-76a9d7927ed2 req-1d02ffb2-311d-45cf-82b6-7c7220292b19 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.331936 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-97089289-9246-4506-82fe-76a9d7927ed2 req-1d02ffb2-311d-45cf-82b6-7c7220292b19 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 944 time: 0.1837234 Sep 16 16:22:27.348801 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:27.377895 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7bee82a8-5a92-4bb1-a5ba-4d3012d5a44a req-a598f48f-7655-4dfc-9ead-1094e6b85cc7 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5116661 Sep 16 16:22:27.418322 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.418956 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:27.419175 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317a207e-6d1d-43f6-ab51-5848749af3ce req-f942ccbf-f721-4ac5-8165-6aecd3669d1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.420535 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] 10.222.0.66 "PUT /v2.0/ports/4056f695-287f-45f7-bd60-21b6a8421280 HTTP/1.1" status: 200 len: 1094 time: 1.2261994 Sep 16 16:22:27.421401 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-317a207e-6d1d-43f6-ab51-5848749af3ce req-f942ccbf-f721-4ac5-8165-6aecd3669d1e service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 919 time: 0.5065899 Sep 16 16:22:27.425319 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b35faf20-f24b-421f-990f-568547d5b9fb req-4715f204-1c04-4c74-b7fd-ca42c43293a6 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023419 Sep 16 16:22:27.436278 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-97089289-9246-4506-82fe-76a9d7927ed2 req-1e4a61fa-09a8-4cbb-8ffd-aa1daef9bbbd tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1033967 Sep 16 16:22:27.436948 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'tag': '4056f695-287f-45f7-bd60-21b6a8421280'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:27.445277 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0390a637-fd94-4e79-9c97-3d9affb60cd3" -d '{"events": [{"name": "network-changed", "server_uuid": "f4270a41-8af0-4e57-9dc8-15227e6ab264", "tag": "4056f695-287f-45f7-bd60-21b6a8421280"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:27.562172 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d41cc38d-1c0b-4ccf-a7c9-4eab0bd00e74 service neutron] Pushing event updated for resources: {'Port': ['ID=4056f695-287f-45f7-bd60-21b6a8421280,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:27.601969 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-5c7eab16-b2a2-4570-8091-7b6bd70ce8c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.604440 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-5c7eab16-b2a2-4570-8091-7b6bd70ce8c6 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 1096 time: 0.1074865 Sep 16 16:22:27.620366 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fd130-cda0-47a5-a43b-95ce784a0b3c req-d66e44b4-ffac-4f68-8b54-beca0fe7aeb1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.629005 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4e1fd130-cda0-47a5-a43b-95ce784a0b3c req-d66e44b4-ffac-4f68-8b54-beca0fe7aeb1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.0794044 Sep 16 16:22:27.691742 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fed4266e-f4bb-45ef-82ca-2eb909f35d6f req-9e08d917-fbca-4419-b591-3cfad23d8b20 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 210 time: 0.0661590 Sep 16 16:22:27.747586 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-477cb7ba-9dbd-49e5-a339-7cb7de1d11a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.752264 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-477cb7ba-9dbd-49e5-a339-7cb7de1d11a6 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 1097 time: 0.2262778 Sep 16 16:22:27.760683 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317a207e-6d1d-43f6-ab51-5848749af3ce req-03afd56a-f28f-476e-93a3-51cf5f2c158b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.764103 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-317a207e-6d1d-43f6-ab51-5848749af3ce req-03afd56a-f28f-476e-93a3-51cf5f2c158b service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3263638 Sep 16 16:22:27.778494 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4e1fd130-cda0-47a5-a43b-95ce784a0b3c req-99e0ffdc-7a90-4d1e-a46c-ac53c4f8b422 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1485307 Sep 16 16:22:27.843041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e994a22-85ea-413e-90ae-181d786ffdde x-openstack-request-id: req-2e994a22-85ea-413e-90ae-181d786ffdde {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:27.843956 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f4270a41-8af0-4e57-9dc8-15227e6ab264", "tag": "4056f695-287f-45f7-bd60-21b6a8421280", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:27.844507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-2e994a22-85ea-413e-90ae-181d786ffdde {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:27.845112 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'tag': '4056f695-287f-45f7-bd60-21b6a8421280', 'status': 'completed', 'code': 200} Sep 16 16:22:27.881943 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-95c60d38-972a-4535-84be-b9ee685dbd1c service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4056f695-287f-45f7-bd60-21b6a8421280 HTTP/1.1" status: 200 len: 217 time: 0.1156952 Sep 16 16:22:27.934826 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-68c68d3f-0aec-4b44-9a72-0ead87c767da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:27.936545 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-68c68d3f-0aec-4b44-9a72-0ead87c767da service neutron] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 916 time: 0.2964950 Sep 16 16:22:28.068097 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-f104fa70-2b4a-4014-a7d1-f74063a87a29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.070427 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-f104fa70-2b4a-4014-a7d1-f74063a87a29 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1096 time: 0.1929524 Sep 16 16:22:28.074819 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c711223c-57d5-434a-a50c-f92dfac7112c req-b40c5416-0909-4759-a63c-809c619a5c24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.077961 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-b40c5416-0909-4759-a63c-809c619a5c24 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.1854799 Sep 16 16:22:28.187119 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-207cd691-f737-4cfe-ae1d-be32558b0ab7 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 217 time: 0.1048911 Sep 16 16:22:28.189168 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-225fd5c1-24d4-4706-bb99-a4f9a6da4e9b service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0956304 Sep 16 16:22:28.226003 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-cbf64b49-5760-45a4-8d0c-6912c963afac service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3 HTTP/1.1" status: 200 len: 217 time: 0.2806284 Sep 16 16:22:28.299554 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-3192d006-eeee-4720-b7ed-27bc3e3e02ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.303740 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-3192d006-eeee-4720-b7ed-27bc3e3e02ad service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.0705566 Sep 16 16:22:28.312100 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-1a654ff4-ae50-4ee9-9b46-99ef334cc2a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.313303 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-1a654ff4-ae50-4ee9-9b46-99ef334cc2a4 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.1099505 Sep 16 16:22:28.364585 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-0e1fdaab-7d05-4a32-ad68-b6bcc8dd671d service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0421097 Sep 16 16:22:28.364764 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-5ea1271e-4331-431c-b811-7b1ecd30c93a service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0512719 Sep 16 16:22:28.380553 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-bacd3d90-e31d-4c33-8ab9-88a5dd9c99d6 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1783319 Sep 16 16:22:28.494089 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-c633c6c1-80ff-4792-8baf-9f6b22568683 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1160002 Sep 16 16:22:28.582892 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-e9db2c60-79b0-4e01-b3bb-ba61db9938c0 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1938770 Sep 16 16:22:28.588489 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c711223c-57d5-434a-a50c-f92dfac7112c req-cd3086bd-edba-47df-9ae8-ee2ec239af35 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1981428 Sep 16 16:22:28.704223 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c73f549-6aa5-4ae6-bc67-1b87c15a768f req-23263364-3458-4c42-bc88-219fc06f403e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.711691 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3c73f549-6aa5-4ae6-bc67-1b87c15a768f req-23263364-3458-4c42-bc88-219fc06f403e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 944 time: 0.1245840 Sep 16 16:22:28.779471 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bb5eed-e102-43e4-a91e-d8813bd29b8b req-c8e0b5fc-765a-4e6d-8076-b1980bd39290 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.781037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a6bb5eed-e102-43e4-a91e-d8813bd29b8b req-c8e0b5fc-765a-4e6d-8076-b1980bd39290 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.1841176 Sep 16 16:22:28.786588 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-6370f46d-c253-4c56-bcda-9863a89e1c87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.788127 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-6370f46d-c253-4c56-bcda-9863a89e1c87 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 1097 time: 0.1201200 Sep 16 16:22:28.799110 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3c73f549-6aa5-4ae6-bc67-1b87c15a768f req-7f9e7eca-bbad-4a66-bbcc-9c44a2f649fa tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867515 Sep 16 16:22:28.801947 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0d48f046-b408-4cb3-81ed-9debb5fc4ee2 req-0aff9d56-a38d-4674-a54b-2435caa1f489 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2996032 Sep 16 16:22:28.857250 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-00a0cbd2-dcf8-4662-9119-a2e2d7a03f62 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2617500 Sep 16 16:22:28.867531 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a6bb5eed-e102-43e4-a91e-d8813bd29b8b req-e680e23a-277b-47a4-b371-3b013a5564b0 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764468 Sep 16 16:22:28.967408 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-b9134867-60fc-4e02-86bc-708cee347207 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:28.968860 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-b9134867-60fc-4e02-86bc-708cee347207 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.1669929 Sep 16 16:22:29.059479 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5582b873-988c-4324-89a4-f9ea99f807a4 req-3bc023f0-4b63-4d3f-be48-b54b2fbcb1c1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 210 time: 0.0809333 Sep 16 16:22:29.139077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b67674c8-7adf-4b7b-81f8-021f6b072271 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:29.144046 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b67674c8-7adf-4b7b-81f8-021f6b072271 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 810 time: 0.3103812 Sep 16 16:22:29.216416 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-766cc293-f088-4186-93d8-2c7135307f50 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=36186b0d094344dbb7b6d93645ae77e1 HTTP/1.1" status: 200 len: 379 time: 0.0589671 Sep 16 16:22:29.231654 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'port': {'device_id': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'admin_state_up': True, 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'security_groups': ['a35ea1a4-42a6-4e95-821b-d662c756858f']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:29.280585 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-b124a550-7ecb-4e72-8986-f6346a5a530f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4056f695-287f-45f7-bd60-21b6a8421280 HTTP/1.1" status: 200 len: 217 time: 0.3015759 Sep 16 16:22:29.371350 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd4067a-3c86-4e8b-bf44-3dc622c24e39 req-ce9cfa80-dbd2-4556-a2c8-c7c3b0e85abf tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:29.373241 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Made reservation on behalf of 36186b0d094344dbb7b6d93645ae77e1 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:29.378420 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-dcd4067a-3c86-4e8b-bf44-3dc622c24e39 req-ce9cfa80-dbd2-4556-a2c8-c7c3b0e85abf tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.1058350 Sep 16 16:22:29.382004 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:29.411568 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-7257e471-3bae-457f-aafb-e1038f97f60c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:29.413566 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-7257e471-3bae-457f-aafb-e1038f97f60c service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0981309 Sep 16 16:22:29.431926 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-dcd4067a-3c86-4e8b-bf44-3dc622c24e39 req-91656937-0af9-4873-8ff9-890d846d2231 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525329 Sep 16 16:22:29.471265 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-11154e39-ad55-4113-ae3a-af56e80c6bc5 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0378978 Sep 16 16:22:29.537474 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Allocated IP 172.20.0.12 (baca97e8-c07b-484a-a0fa-c440a2abcfed/94ba1df5-707c-4998-b69b-115427a08b60/bffdae71-37f3-4fff-8a1f-24159107e4eb) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:29.614027 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-a3dc3102-1fec-4f9e-8529-f0e2a3827235 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1333656 Sep 16 16:22:29.698224 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:29.715507 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0390a637-fd94-4e79-9c97-3d9affb60cd3 req-4c2ac1bf-450c-4d63-a059-f1c769e1895e service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901971 Sep 16 16:22:29.735581 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:29.742439 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35178) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:29.778394 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Network baca97e8-c07b-484a-a0fa-c440a2abcfed is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:29.781413 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:29.785283 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:29.790871 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:29.791467 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:29.802166 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:29.814907 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-95872083-dab7-4fc2-84c5-8f90d9d53c3c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5910871 Sep 16 16:22:29.826943 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Request body: {'port': {'device_id': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:29.856909 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4d973e3f-fa01-4de9-a85c-ffb72ea3fc84 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:29.897855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:29.939339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e23a376e-556e-4737-ada1-f038ddbcf060 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:22:30.002070 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40206ba3-2213-435f-b5fe-b5a76c34fd91 req-d3c3d0ab-1355-48a6-800b-f212dffb922b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:30.003616 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-40206ba3-2213-435f-b5fe-b5a76c34fd91 req-d3c3d0ab-1355-48a6-800b-f212dffb922b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 944 time: 0.1225343 Sep 16 16:22:30.022500 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4d973e3f-fa01-4de9-a85c-ffb72ea3fc84 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.030867 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd04ca6-19cd-46d4-a367-d0401968569d req-51f5de3a-7bdf-4643-98ff-0d2eee2bd3ae tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:30.038991 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3bd04ca6-19cd-46d4-a367-d0401968569d req-51f5de3a-7bdf-4643-98ff-0d2eee2bd3ae tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 944 time: 0.0850694 Sep 16 16:22:30.064155 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4d973e3f-fa01-4de9-a85c-ffb72ea3fc84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.086444 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-6b8ec942-4796-4bfd-948f-5e52823e8879 None None] Provisioning complete for port bffdae71-37f3-4fff-8a1f-24159107e4eb triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:30.086877 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6b8ec942-4796-4bfd-948f-5e52823e8879 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.124678 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3bd04ca6-19cd-46d4-a367-d0401968569d req-0a998f81-c6e6-41dd-8441-76683b4e5218 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0846848 Sep 16 16:22:30.128283 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e23a376e-556e-4737-ada1-f038ddbcf060, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e23a376e-556e-4737-ada1-f038ddbcf060,segment=NetworkSegment(6f8c7cc7-81db-4318-8cb5-16b891d859e6),segment_id=6f8c7cc7-81db-4318-8cb5-16b891d859e6)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:30.132363 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-40206ba3-2213-435f-b5fe-b5a76c34fd91 req-09cd5ab8-4695-4bc6-b642-e7e1024ee79e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114931 Sep 16 16:22:30.151243 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'e23a376e-556e-4737-ada1-f038ddbcf060', 'network_id': 'b4c32c31-4aa7-4c54-bdb8-3e5674bb6304', 'port_id': 'e23a376e-556e-4737-ada1-f038ddbcf060', 'mac_address': 'fa:16:3e:a0:00:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 731, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4933948-8e0f-4ede-a776-0bbd1e3c2a6c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:22:30.153051 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-6b8ec942-4796-4bfd-948f-5e52823e8879 None None] Port bffdae71-37f3-4fff-8a1f-24159107e4eb cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:22:30.162757 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4d973e3f-fa01-4de9-a85c-ffb72ea3fc84 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=022acb92a1734b5fb4640ceaf54095b8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4186027 Sep 16 16:22:30.166079 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35192) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:30.179427 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d973e3f-fa01-4de9-a85c-ffb72ea3fc84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab264734-3d13-439f-bf25-1a2714e17438,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:30.200740 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.217346 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e23a376e-556e-4737-ada1-f038ddbcf060 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:30.246787 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e23a376e-556e-4737-ada1-f038ddbcf060, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e23a376e-556e-4737-ada1-f038ddbcf060,segment=NetworkSegment(6f8c7cc7-81db-4318-8cb5-16b891d859e6),segment_id=6f8c7cc7-81db-4318-8cb5-16b891d859e6)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:30.254228 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.254891 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:22:30.339266 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bffdae71-37f3-4fff-8a1f-24159107e4eb {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:30.345403 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c5ea3549-4dad-4933-98bd-8519490ad565 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.347236 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.349701 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=e23a376e-556e-4737-ada1-f038ddbcf060,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:30.364078 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Transition to ACTIVE for port object bffdae71-37f3-4fff-8a1f-24159107e4eb will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:22:30.370137 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.393650 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b36291-226c-43b1-acf8-da7d300a7044 req-dc81dd45-afa5-482b-a1de-777e67c355ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:30.395393 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-01b36291-226c-43b1-acf8-da7d300a7044 req-dc81dd45-afa5-482b-a1de-777e67c355ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 932 time: 0.1241982 Sep 16 16:22:30.397412 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c5ea3549-4dad-4933-98bd-8519490ad565 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.430904 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:30.447010 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'port_id': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'mac_address': 'fa:16:3e:c8:e1:73', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 703, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '57a636e1-0951-4c2f-8be2-8ca36acb1d05', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:22:30.472793 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-01b36291-226c-43b1-acf8-da7d300a7044 req-461a2256-a0f9-4f99-94fc-78c46c73ac2b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0685203 Sep 16 16:22:30.481690 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c5ea3549-4dad-4933-98bd-8519490ad565 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.484240 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c5ea3549-4dad-4933-98bd-8519490ad565 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.487794 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c5ea3549-4dad-4933-98bd-8519490ad565 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/ab264734-3d13-439f-bf25-1a2714e17438 HTTP/1.1" status: 204 len: 168 time: 0.3149602 Sep 16 16:22:30.501011 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ea3549-4dad-4933-98bd-8519490ad565 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab264734-3d13-439f-bf25-1a2714e17438,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:30.507247 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:30.521000 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Attempting to bind port bffdae71-37f3-4fff-8a1f-24159107e4eb on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:30.521322 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Attempting to bind port bffdae71-37f3-4fff-8a1f-24159107e4eb by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:30.521705 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Attempting to bind port bffdae71-37f3-4fff-8a1f-24159107e4eb on network baca97e8-c07b-484a-a0fa-c440a2abcfed {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:30.529082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Port bffdae71-37f3-4fff-8a1f-24159107e4eb on network baca97e8-c07b-484a-a0fa-c440a2abcfed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:22:30.529082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Attempting to bind port bffdae71-37f3-4fff-8a1f-24159107e4eb on network baca97e8-c07b-484a-a0fa-c440a2abcfed {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:30.536213 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 22, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:30.536553 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Checking segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:30.537086 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Bound using segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:30.537533 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Bound port: bffdae71-37f3-4fff-8a1f-24159107e4eb, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:30.538059 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.586718 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.631614 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:30.664071 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:30.671191 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.726957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:30.739124 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:30.750567 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c7e90b-aaf5-4527-8ecb-e5eb9919b324 req-f0d80187-2459-4614-be93-ec31e5880139 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:30.750967 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:30.752703 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-60c7e90b-aaf5-4527-8ecb-e5eb9919b324 req-f0d80187-2459-4614-be93-ec31e5880139 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 943 time: 0.2101314 Sep 16 16:22:30.756198 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.811983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:30.813516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.814940 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-b28748da-382c-416d-902b-85d9ed26254a service neutron] 10.222.0.66 "PUT /v2.0/ports/bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 1094 time: 0.9923534 Sep 16 16:22:30.817632 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:30.826229 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf" -d '{"events": [{"name": "network-changed", "server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:30.916006 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-392f5354-c079-4ec8-a22f-bdd7a9d41be5 x-openstack-request-id: req-392f5354-c079-4ec8-a22f-bdd7a9d41be5 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:30.916307 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:30.916553 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-392f5354-c079-4ec8-a22f-bdd7a9d41be5 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:30.916961 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'status': 'completed', 'code': 200} Sep 16 16:22:30.954541 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-60c7e90b-aaf5-4527-8ecb-e5eb9919b324 req-5d94e521-77ef-41fb-89d5-919d679dddc7 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1570349 Sep 16 16:22:30.958474 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28748da-382c-416d-902b-85d9ed26254a service neutron] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:30.971523 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['e23a376e-556e-4737-ada1-f038ddbcf060'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:22:30.979394 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35220) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:30.991854 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-ac8b813b-e825-4564-8cac-05d18827c053 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:30.994133 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-ac8b813b-e825-4564-8cac-05d18827c053 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1097 time: 0.1264775 Sep 16 16:22:30.996908 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fb7068bd-a815-4a94-bd60-f4c2c462e94d admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:30.999081 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:22:31.047858 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-187c2765-cfa7-4f27-96dd-de5719a9495b service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 217 time: 0.0438356 Sep 16 16:22:31.157336 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fb7068bd-a815-4a94-bd60-f4c2c462e94d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:31.162937 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fb7068bd-a815-4a94-bd60-f4c2c462e94d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:31.216776 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-fb7068bd-a815-4a94-bd60-f4c2c462e94d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=1959d1d3309143c8af207c4e782ab777&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2337015 Sep 16 16:22:31.216776 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb7068bd-a815-4a94-bd60-f4c2c462e94d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a05ccd0a-3445-4cc7-b595-d8b355b2bfb2,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:31.217811 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35234) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:31.297225 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e1845-d16b-48f8-8266-d0e559bb1842 req-88fdd997-8ce2-4554-9c6d-267100022a90 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:31.304607 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8b3e1845-d16b-48f8-8266-d0e559bb1842 req-88fdd997-8ce2-4554-9c6d-267100022a90 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 945 time: 0.0553181 Sep 16 16:22:31.319088 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bd06461b-f16b-4691-a950-d4c1c80d6a09 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:31.345505 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8b3e1845-d16b-48f8-8266-d0e559bb1842 req-2994839a-59cb-4b22-90d1-576a7cc52825 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398431 Sep 16 16:22:31.349464 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bd06461b-f16b-4691-a950-d4c1c80d6a09 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:31.358336 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6dbc5d6-d25e-4585-9599-de8a7a13eeb3 req-d09c8923-1613-4f85-b5a9-6875984b01c4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:31.359895 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a6dbc5d6-d25e-4585-9599-de8a7a13eeb3 req-d09c8923-1613-4f85-b5a9-6875984b01c4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 944 time: 0.0952737 Sep 16 16:22:31.418136 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a6dbc5d6-d25e-4585-9599-de8a7a13eeb3 req-e342c703-f50a-42e3-994e-747da090c4e3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483930 Sep 16 16:22:31.442451 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bd06461b-f16b-4691-a950-d4c1c80d6a09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:31.443012 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-bd06461b-f16b-4691-a950-d4c1c80d6a09 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:31.449731 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-bd06461b-f16b-4691-a950-d4c1c80d6a09 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a05ccd0a-3445-4cc7-b595-d8b355b2bfb2 HTTP/1.1" status: 204 len: 168 time: 0.2302706 Sep 16 16:22:31.460670 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd06461b-f16b-4691-a950-d4c1c80d6a09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a05ccd0a-3445-4cc7-b595-d8b355b2bfb2,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:31.613593 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e839a1-39a9-4b8b-b55a-cde12705a54a req-5ababcd1-c00a-48ea-bb47-d27e7a28ab36 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:31.615011 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-21e839a1-39a9-4b8b-b55a-cde12705a54a req-5ababcd1-c00a-48ea-bb47-d27e7a28ab36 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0628619 Sep 16 16:22:31.676930 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-21e839a1-39a9-4b8b-b55a-cde12705a54a req-1faa4b8f-0622-41d7-9677-618db69ca20a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527213 Sep 16 16:22:31.960691 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-75b0bfbb-304e-4df8-9de5-5cc8f74ce03f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:31.962638 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-75b0bfbb-304e-4df8-9de5-5cc8f74ce03f service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0458424 Sep 16 16:22:32.061963 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f67f77-6f4e-463a-965d-9b45eeb4788f req-649f7942-0e5f-4c95-a17f-3d0c4108e58e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:32.063461 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c1f67f77-6f4e-463a-965d-9b45eeb4788f req-649f7942-0e5f-4c95-a17f-3d0c4108e58e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 944 time: 0.0516562 Sep 16 16:22:32.101640 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c1f67f77-6f4e-463a-965d-9b45eeb4788f req-8008b9f6-28b2-4660-bb8c-5611181e72a4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321498 Sep 16 16:22:32.453952 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0fa829-fba2-4285-bffa-c3666271c4c4 req-2ea25c71-d49f-459a-8c06-8d0b8f58b290 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:32.455634 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ae0fa829-fba2-4285-bffa-c3666271c4c4 req-2ea25c71-d49f-459a-8c06-8d0b8f58b290 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 945 time: 0.0496569 Sep 16 16:22:32.499814 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ae0fa829-fba2-4285-bffa-c3666271c4c4 req-a9749b40-9029-4541-b851-a76e9fa45cad tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373015 Sep 16 16:22:32.537442 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61af83c7-0b12-42d6-a60b-de9d018eb949 req-9b8c2e08-8d8a-4654-98ae-26efa047ed49 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:32.538920 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-61af83c7-0b12-42d6-a60b-de9d018eb949 req-9b8c2e08-8d8a-4654-98ae-26efa047ed49 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 944 time: 0.0475881 Sep 16 16:22:32.577911 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-61af83c7-0b12-42d6-a60b-de9d018eb949 req-4a0bb3d8-d9cb-4402-af1f-5f2f47a358fa tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323625 Sep 16 16:22:32.805806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7a7d80-5f94-48f9-b958-563aaebb05c8 req-78a16d4e-d5f6-4ade-9603-62b3324ef7bb tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:32.807502 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3f7a7d80-5f94-48f9-b958-563aaebb05c8 req-78a16d4e-d5f6-4ade-9603-62b3324ef7bb tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0584500 Sep 16 16:22:32.822281 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-76f00f4d-35e1-47fc-b08e-756ffac5ffe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:32.824129 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-76f00f4d-35e1-47fc-b08e-756ffac5ffe8 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0645432 Sep 16 16:22:32.849219 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3f7a7d80-5f94-48f9-b958-563aaebb05c8 req-49076cec-8f08-432b-9807-e84acd20d657 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358670 Sep 16 16:22:33.079856 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35312) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:33.205302 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-17c039d9-c3d5-4fdb-88f6-f802021cbfc3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.238645 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61dbda8-5e01-4bac-8997-d6f7fdc46f07 req-cca32e50-e72f-4a22-936c-035ad6de8b19 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:33.240064 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a61dbda8-5e01-4bac-8997-d6f7fdc46f07 req-cca32e50-e72f-4a22-936c-035ad6de8b19 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 944 time: 0.0735753 Sep 16 16:22:33.295521 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a61dbda8-5e01-4bac-8997-d6f7fdc46f07 req-c1e64aa5-a000-404f-a92a-63a147179535 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481088 Sep 16 16:22:33.340604 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-17c039d9-c3d5-4fdb-88f6-f802021cbfc3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.344402 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-17c039d9-c3d5-4fdb-88f6-f802021cbfc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.382064 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-17c039d9-c3d5-4fdb-88f6-f802021cbfc3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=254138623c91446283ecdd0dadefde68&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3010113 Sep 16 16:22:33.390369 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c039d9-c3d5-4fdb-88f6-f802021cbfc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=510567cf-514e-48f0-8674-294afb5cf089,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:33.390606 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35322) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:33.432750 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0bbc91ce-38e1-49ae-93b9-9a231cad8b0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.453850 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0bbc91ce-38e1-49ae-93b9-9a231cad8b0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.500296 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0bbc91ce-38e1-49ae-93b9-9a231cad8b0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.502854 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0bbc91ce-38e1-49ae-93b9-9a231cad8b0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.504003 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0bbc91ce-38e1-49ae-93b9-9a231cad8b0b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/510567cf-514e-48f0-8674-294afb5cf089 HTTP/1.1" status: 204 len: 168 time: 0.1176646 Sep 16 16:22:33.511300 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bbc91ce-38e1-49ae-93b9-9a231cad8b0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=510567cf-514e-48f0-8674-294afb5cf089,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:33.614294 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd7a916a-2976-42f0-8ce4-5edcdc285d3f req-9dbb9f90-339e-469f-adad-facbf848eecf tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:33.615791 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fd7a916a-2976-42f0-8ce4-5edcdc285d3f req-9dbb9f90-339e-469f-adad-facbf848eecf tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 945 time: 0.0497839 Sep 16 16:22:33.662527 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fd7a916a-2976-42f0-8ce4-5edcdc285d3f req-0f339581-526c-4a3b-a3f8-1207456110bc tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374122 Sep 16 16:22:33.702084 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bec15e-5775-4f90-b35b-9ebcb1419a8c req-aa54d137-dc48-4bc4-95a7-47a17d701a7d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:33.703586 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-10bec15e-5775-4f90-b35b-9ebcb1419a8c req-aa54d137-dc48-4bc4-95a7-47a17d701a7d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 944 time: 0.0529537 Sep 16 16:22:33.720721 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e42ecb5c-bf82-4da7-a301-2a3b2912db3d details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:22:33.790938 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35332) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:33.805827 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7230cb81-820e-4e61-87b1-c4a027ff620b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.812638 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-10bec15e-5775-4f90-b35b-9ebcb1419a8c req-f5c3e497-641c-46b2-b8ea-3877bd66fc0e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010566 Sep 16 16:22:33.825912 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:33.839098 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-be786ab8-0adb-43bc-9306-679e7db2c225 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304691 Sep 16 16:22:33.845319 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'port_id': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d', 'mac_address': 'fa:16:3e:81:d0:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 721, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:22:33.895147 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.919131 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e42ecb5c-bf82-4da7-a301-2a3b2912db3d {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:33.951709 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a21a52f-581b-4ac2-943c-ca2acb4a0309 req-63d17d89-3a43-47dd-be1a-d528a7ff2e8c service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036630 Sep 16 16:22:33.969681 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:33.975030 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.975919 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 4056f695-287f-45f7-bd60-21b6a8421280 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:22:33.989501 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7230cb81-820e-4e61-87b1-c4a027ff620b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:33.994878 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7230cb81-820e-4e61-87b1-c4a027ff620b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.043546 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7230cb81-820e-4e61-87b1-c4a027ff620b admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=8e1575f80b1c4bb9b284d201338d1e99&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2499461 Sep 16 16:22:34.045026 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 4056f695-287f-45f7-bd60-21b6a8421280, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=4056f695-287f-45f7-bd60-21b6a8421280,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:34.046389 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35342) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:34.048462 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-cfc00925-9fab-4307-a059-1d132aba0e50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:34.050014 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-cfc00925-9fab-4307-a059-1d132aba0e50 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1097 time: 0.0475061 Sep 16 16:22:34.056494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e854d8c7-c2c7-4d36-b8a2-b601bfee1541 req-f937bb84-8054-48af-a9a6-68635c940c60 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:34.056676 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:34.058106 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e854d8c7-c2c7-4d36-b8a2-b601bfee1541 req-f937bb84-8054-48af-a9a6-68635c940c60 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.1295154 Sep 16 16:22:34.063400 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7230cb81-820e-4e61-87b1-c4a027ff620b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e790d04a-8040-4e97-81c3-4a084f79ab3c,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:34.069871 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': '4056f695-287f-45f7-bd60-21b6a8421280', 'network_id': '53267936-cd43-4d76-85cb-9474bc332b78', 'port_id': '4056f695-287f-45f7-bd60-21b6a8421280', 'mac_address': 'fa:16:3e:01:4a:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 721, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c1936e4e-27dd-43b2-be4a-1bdf226e79cc', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:22:34.099803 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e854d8c7-c2c7-4d36-b8a2-b601bfee1541 req-944bbc62-f483-4d98-8170-85ec20993ab2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332680 Sep 16 16:22:34.110557 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.129754 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4056f695-287f-45f7-bd60-21b6a8421280 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:34.148312 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 4056f695-287f-45f7-bd60-21b6a8421280, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=4056f695-287f-45f7-bd60-21b6a8421280,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:34.152335 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.170706 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-480e46bc-78ff-4c84-8a3c-608d20af0084 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.202003 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=4056f695-287f-45f7-bd60-21b6a8421280,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:34.203202 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-c03f8a59-e46f-4054-a364-c9226ef7a66c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:34.205343 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-c03f8a59-e46f-4054-a364-c9226ef7a66c service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.1416709 Sep 16 16:22:34.207383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-480e46bc-78ff-4c84-8a3c-608d20af0084 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.253019 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-480e46bc-78ff-4c84-8a3c-608d20af0084 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.255617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-480e46bc-78ff-4c84-8a3c-608d20af0084 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:34.256723 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-480e46bc-78ff-4c84-8a3c-608d20af0084 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e790d04a-8040-4e97-81c3-4a084f79ab3c HTTP/1.1" status: 204 len: 168 time: 0.2058003 Sep 16 16:22:34.264201 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-480e46bc-78ff-4c84-8a3c-608d20af0084 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e790d04a-8040-4e97-81c3-4a084f79ab3c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:34.410822 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e566d6-0ac1-4d89-a2d1-5a2694fbb88e req-ab47e9d3-62ab-4ce8-9741-92357fa52f8a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:34.412354 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-46e566d6-0ac1-4d89-a2d1-5a2694fbb88e req-ab47e9d3-62ab-4ce8-9741-92357fa52f8a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 944 time: 0.0505872 Sep 16 16:22:34.452565 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-46e566d6-0ac1-4d89-a2d1-5a2694fbb88e req-ba5f4dd3-a489-429c-a8f5-95f8cfc84626 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338101 Sep 16 16:22:34.774582 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d47789-f1fb-4bd2-a6be-c17a2fa33c00 req-1a8028b9-84bc-422a-b7d4-f7616ebdedc2 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:34.776804 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-11d47789-f1fb-4bd2-a6be-c17a2fa33c00 req-1a8028b9-84bc-422a-b7d4-f7616ebdedc2 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 945 time: 0.0512278 Sep 16 16:22:34.817479 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-11d47789-f1fb-4bd2-a6be-c17a2fa33c00 req-7fb9e904-6180-47ee-8a52-f9db566b4532 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345905 Sep 16 16:22:34.936870 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1265d3f5-fbc1-4e06-bf1f-9138b9bb056a req-2f7c479e-dc9f-4dc4-aaed-a91a2e61201f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:34.938336 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1265d3f5-fbc1-4e06-bf1f-9138b9bb056a req-2f7c479e-dc9f-4dc4-aaed-a91a2e61201f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0545950 Sep 16 16:22:34.997523 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1265d3f5-fbc1-4e06-bf1f-9138b9bb056a req-e4563ab2-2832-4c62-8c5f-91a73ba75d2a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462084 Sep 16 16:22:35.165340 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-d4668cb0-185d-45ac-8c0a-08d938d144ae service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 217 time: 0.0343506 Sep 16 16:22:35.219546 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da707be5-8aa3-4eff-b747-a87e47b52369 req-90cfd5f3-9ed0-4575-8c95-88aae9d60270 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:35.221116 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-da707be5-8aa3-4eff-b747-a87e47b52369 req-90cfd5f3-9ed0-4575-8c95-88aae9d60270 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0523176 Sep 16 16:22:35.258787 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-da707be5-8aa3-4eff-b747-a87e47b52369 req-45a42e7c-70af-40b1-a5fc-83a2bad71c54 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318398 Sep 16 16:22:35.563716 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f1c90c-bfd2-411b-9f37-3f3b703f2b87 req-76b3688e-4299-4f32-a214-dd552a018e31 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:35.565175 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6f1c90c-bfd2-411b-9f37-3f3b703f2b87 req-76b3688e-4299-4f32-a214-dd552a018e31 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 944 time: 0.0478497 Sep 16 16:22:35.601399 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6f1c90c-bfd2-411b-9f37-3f3b703f2b87 req-50b8d16b-cbf7-4409-b881-19e4adf067f8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302689 Sep 16 16:22:35.934075 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98707d07-4ce4-43d7-aa3a-b4da2226574e req-f21ff752-7ce7-4029-9e71-af051483b51d tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:35.935576 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-98707d07-4ce4-43d7-aa3a-b4da2226574e req-f21ff752-7ce7-4029-9e71-af051483b51d tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 945 time: 0.0522473 Sep 16 16:22:35.972753 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-98707d07-4ce4-43d7-aa3a-b4da2226574e req-e6440fba-0072-4904-8af4-66c9253b4e87 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311143 Sep 16 16:22:36.009074 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-34682e42-e611-489d-9ef6-fe8922a4e0f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:36.010607 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-34682e42-e611-489d-9ef6-fe8922a4e0f9 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0463340 Sep 16 16:22:36.122088 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c812b30-1691-43ec-8c48-af879d26aa01 req-2be9a14b-cf28-4b9d-860d-808f3f5a0895 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:36.123604 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6c812b30-1691-43ec-8c48-af879d26aa01 req-2be9a14b-cf28-4b9d-860d-808f3f5a0895 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0495977 Sep 16 16:22:36.162482 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6c812b30-1691-43ec-8c48-af879d26aa01 req-ec9cafa4-36d8-4dbd-bcb7-281ad74340e0 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329509 Sep 16 16:22:36.371084 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94121d6b-cb90-4efa-8d44-3926d7341765 req-ef68e01e-8f99-48c9-bc9f-fc0fcc2377ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:36.372613 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-94121d6b-cb90-4efa-8d44-3926d7341765 req-ef68e01e-8f99-48c9-bc9f-fc0fcc2377ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0495353 Sep 16 16:22:36.412937 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-94121d6b-cb90-4efa-8d44-3926d7341765 req-ecca667b-635e-48a7-8716-c8fc1cdaae59 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336528 Sep 16 16:22:36.715668 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3b4e04d-4d41-43ad-8ba2-d8866eff47dc req-bd196337-a84d-4692-809c-4d9e3afe56f8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:36.717121 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f3b4e04d-4d41-43ad-8ba2-d8866eff47dc req-bd196337-a84d-4692-809c-4d9e3afe56f8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 944 time: 0.0468054 Sep 16 16:22:36.754412 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f3b4e04d-4d41-43ad-8ba2-d8866eff47dc req-e1e419de-c7c2-4004-8290-7a1c7b4d5a27 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313447 Sep 16 16:22:36.952171 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e23a376e-556e-4737-ada1-f038ddbcf060 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:36.974962 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-644a55ae-ed75-4367-a42b-4fb20adc3579 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:36.976477 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-644a55ae-ed75-4367-a42b-4fb20adc3579 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0462279 Sep 16 16:22:37.003686 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port e23a376e-556e-4737-ada1-f038ddbcf060 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:22:37.007720 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port e23a376e-556e-4737-ada1-f038ddbcf060 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:37.008470 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:37.072014 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-49a4c36a-32f9-4fe9-a257-66bccd96d46c service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856123 Sep 16 16:22:37.096741 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e3dbc2-e5c0-4515-bab9-b98716ceb811 req-d2717ea2-50a5-4c1c-a30a-cc61d9c3b0d5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:37.103732 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-68e3dbc2-e5c0-4515-bab9-b98716ceb811 req-d2717ea2-50a5-4c1c-a30a-cc61d9c3b0d5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 945 time: 0.0627589 Sep 16 16:22:37.104962 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:37.141695 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68798125-7e39-4c0b-807d-f17667e701f2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e23a376e-556e-4737-ada1-f038ddbcf060'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:37.147120 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-68e3dbc2-e5c0-4515-bab9-b98716ceb811 req-e04bcac2-3c34-4b00-916f-0dcfb5981ea7 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373657 Sep 16 16:22:37.194827 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-96bfb8f1-203f-4efb-b5ef-62a6a2113cbf req-bc79c8be-a4bf-423d-9a9d-2708062e80db service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1147618 Sep 16 16:22:37.248773 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['4056f695-287f-45f7-bd60-21b6a8421280'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:22:37.251902 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['e42ecb5c-bf82-4da7-a301-2a3b2912db3d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:22:37.298753 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7176ad4a-8149-4af5-9c7a-514ad48cd22f req-ce71a687-6172-4c22-8593-4dfebc81b3ab tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:37.300273 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7176ad4a-8149-4af5-9c7a-514ad48cd22f req-ce71a687-6172-4c22-8593-4dfebc81b3ab tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0631049 Sep 16 16:22:37.313406 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e23a376e-556e-4737-ada1-f038ddbcf060, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e23a376e-556e-4737-ada1-f038ddbcf060,segment=NetworkSegment(6f8c7cc7-81db-4318-8cb5-16b891d859e6),segment_id=6f8c7cc7-81db-4318-8cb5-16b891d859e6)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:37.323888 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:37.324707 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:37.346876 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7176ad4a-8149-4af5-9c7a-514ad48cd22f req-16939736-ea4e-447a-8fb2-8ee783f918d9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387247 Sep 16 16:22:37.405034 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-daac2c3b-7b2b-4618-9bcb-822a57029990" -d '{"events": [{"server_uuid": "68798125-7e39-4c0b-807d-f17667e701f2", "name": "network-vif-plugged", "status": "completed", "tag": "e23a376e-556e-4737-ada1-f038ddbcf060"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:37.469347 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=e23a376e-556e-4737-ada1-f038ddbcf060,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:37.507482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:22:37.515144 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58286ce0-817a-4957-bab5-b1663f65271b x-openstack-request-id: req-58286ce0-817a-4957-bab5-b1663f65271b {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:37.515466 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "68798125-7e39-4c0b-807d-f17667e701f2", "name": "network-vif-plugged", "status": "completed", "tag": "e23a376e-556e-4737-ada1-f038ddbcf060", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:37.515722 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-58286ce0-817a-4957-bab5-b1663f65271b {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:37.516182 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '68798125-7e39-4c0b-807d-f17667e701f2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e23a376e-556e-4737-ada1-f038ddbcf060', 'code': 200} Sep 16 16:22:37.530900 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:37.531294 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:37.532762 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b36160-374d-4538-bd46-f6701107a2c5 req-fa00ab44-bd30-4637-9d5a-f025961f7b45 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:37.534184 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c9b36160-374d-4538-bd46-f6701107a2c5 req-fa00ab44-bd30-4637-9d5a-f025961f7b45 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0491629 Sep 16 16:22:37.572785 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c9b36160-374d-4538-bd46-f6701107a2c5 req-ba90a22a-84b0-4019-bb3a-e3c1b7e1f927 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320156 Sep 16 16:22:37.678069 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:37.709269 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:37.712691 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:37.760666 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:37.871307 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1711d38-0e59-48e8-9e4f-5e49647c126b req-1bc6f805-630c-4b52-be5f-5eea8919dcb1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:37.872742 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f1711d38-0e59-48e8-9e4f-5e49647c126b req-1bc6f805-630c-4b52-be5f-5eea8919dcb1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0502946 Sep 16 16:22:37.908389 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f1711d38-0e59-48e8-9e4f-5e49647c126b req-e689b72a-2a50-4a3c-a8a9-a00acc7b2df2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0297492 Sep 16 16:22:38.265149 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6addbe5b-b497-4400-889f-1311b65ead03 req-0beadb09-d947-4c0f-8972-0021c0deaee1 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:38.266732 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6addbe5b-b497-4400-889f-1311b65ead03 req-0beadb09-d947-4c0f-8972-0021c0deaee1 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0525522 Sep 16 16:22:38.321501 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6addbe5b-b497-4400-889f-1311b65ead03 req-3594d18f-fac4-4b96-bb9e-b04fb800574d tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462401 Sep 16 16:22:38.464464 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c06f5dc9-3a44-4c97-8102-fa312b3b0324 req-b94994a2-6ba6-48ed-b28d-bebdfa6d2ea3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:38.466049 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c06f5dc9-3a44-4c97-8102-fa312b3b0324 req-b94994a2-6ba6-48ed-b28d-bebdfa6d2ea3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0533350 Sep 16 16:22:38.511750 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c06f5dc9-3a44-4c97-8102-fa312b3b0324 req-2fb3ce6e-fc33-4293-8440-321e032a8029 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398512 Sep 16 16:22:38.689090 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b812f0-3614-444d-9a95-f4c8f263c7a6 req-a491955c-5080-4a53-8783-32240b681546 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:38.690778 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-29b812f0-3614-444d-9a95-f4c8f263c7a6 req-a491955c-5080-4a53-8783-32240b681546 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0493689 Sep 16 16:22:38.728759 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-29b812f0-3614-444d-9a95-f4c8f263c7a6 req-0f089878-6cf5-4f5c-9ba2-c313e5b7d415 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310276 Sep 16 16:22:39.020252 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da3782a-0242-49c2-89ee-fe87a6c2d84d req-9f519d9a-6e1f-4f93-a8ee-b3597b60dd39 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:39.021724 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2da3782a-0242-49c2-89ee-fe87a6c2d84d req-9f519d9a-6e1f-4f93-a8ee-b3597b60dd39 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0477891 Sep 16 16:22:39.058787 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2da3782a-0242-49c2-89ee-fe87a6c2d84d req-9d3f9173-22de-40a1-ac68-d9936155735e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313084 Sep 16 16:22:39.431263 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa09e8f1-1658-4b7f-9d84-791f429989a4 req-74187a26-f7c4-47cb-ae19-f11fb8e894c5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:39.432794 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa09e8f1-1658-4b7f-9d84-791f429989a4 req-74187a26-f7c4-47cb-ae19-f11fb8e894c5 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0474272 Sep 16 16:22:39.470112 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa09e8f1-1658-4b7f-9d84-791f429989a4 req-f51b9d79-2638-41f1-8c4c-0b2c9e793fc6 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313098 Sep 16 16:22:39.517843 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:39.524625 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60255a98-fa43-4f77-967a-ca03ec9d9cb2" -d '{"events": [{"server_uuid": "2c827e7d-de34-4f39-9e3e-62e6bc0c387c", "name": "network-vif-plugged", "status": "completed", "tag": "2f6c8a4f-a8c2-4261-b743-89b4b84383d3"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:39.559492 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce7ecfb3-6e3b-4278-80fe-dbaf91a6db0f x-openstack-request-id: req-ce7ecfb3-6e3b-4278-80fe-dbaf91a6db0f {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:39.559788 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c827e7d-de34-4f39-9e3e-62e6bc0c387c", "name": "network-vif-plugged", "status": "completed", "tag": "2f6c8a4f-a8c2-4261-b743-89b4b84383d3", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:39.560044 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-ce7ecfb3-6e3b-4278-80fe-dbaf91a6db0f {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:39.560464 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'code': 200} Sep 16 16:22:39.627540 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4faf2546-0b4c-4c08-a83f-f471a6de0ff9 req-433080a4-f60d-4f24-b6e1-28d5bd4b0eb9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:39.628913 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4faf2546-0b4c-4c08-a83f-f471a6de0ff9 req-433080a4-f60d-4f24-b6e1-28d5bd4b0eb9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0496488 Sep 16 16:22:39.663814 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4faf2546-0b4c-4c08-a83f-f471a6de0ff9 req-22d08521-0ed0-4998-8ac2-d9d496a1ef7b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0291684 Sep 16 16:22:39.848993 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96215d0-0caf-410a-8a6d-170f0afb4a96 req-d8accb50-ec33-4d34-9d84-3135d855ca8f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:39.850723 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f96215d0-0caf-410a-8a6d-170f0afb4a96 req-d8accb50-ec33-4d34-9d84-3135d855ca8f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0547462 Sep 16 16:22:39.888639 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f96215d0-0caf-410a-8a6d-170f0afb4a96 req-c4883c25-57b5-401d-bfc6-5602b450b73e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319948 Sep 16 16:22:40.174875 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7936888e-c3ed-4456-9c9b-97bd4e2c508a req-0f759c89-4b64-40ff-96eb-3efe15105dbb tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:40.176990 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7936888e-c3ed-4456-9c9b-97bd4e2c508a req-0f759c89-4b64-40ff-96eb-3efe15105dbb tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0534141 Sep 16 16:22:40.232177 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7936888e-c3ed-4456-9c9b-97bd4e2c508a req-5b5e994c-3d45-49f5-ab95-533e33bef6dc tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468118 Sep 16 16:22:40.350251 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c15da80-ee96-40fc-896b-83a611f3c226 req-8380bfb3-21ae-4a37-b7a5-d5588dc5d5bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:40.351776 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6c15da80-ee96-40fc-896b-83a611f3c226 req-8380bfb3-21ae-4a37-b7a5-d5588dc5d5bd service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 1098 time: 0.0667005 Sep 16 16:22:40.352612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f1fa6c-2455-4673-ae27-6ce1d807504c req-d5c167db-e05b-4332-85f3-16c9d0f4c511 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:40.354063 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-80f1fa6c-2455-4673-ae27-6ce1d807504c req-d5c167db-e05b-4332-85f3-16c9d0f4c511 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 1099 time: 0.0702178 Sep 16 16:22:40.380253 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-6c15da80-ee96-40fc-896b-83a611f3c226 req-4414666e-0334-410f-9c31-805dc04880c8 service neutron] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:40.477579 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-6c15da80-ee96-40fc-896b-83a611f3c226 req-4414666e-0334-410f-9c31-805dc04880c8 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:40.482584 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-6c15da80-ee96-40fc-896b-83a611f3c226 req-4414666e-0334-410f-9c31-805dc04880c8 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:40.514929 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6c15da80-ee96-40fc-896b-83a611f3c226 req-4414666e-0334-410f-9c31-805dc04880c8 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1451335 Sep 16 16:22:40.537933 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4414666e-0334-410f-9c31-805dc04880c8 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=f02ff3a2-61f9-4069-ae52-f7663ac72943,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:40.556035 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-80f1fa6c-2455-4673-ae27-6ce1d807504c req-73d657ba-baa7-4d50-ad14-d4f47bf5ef94 service neutron] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:40.619662 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afbfc442-0011-42a7-98e1-29bfc054f014 req-eddd83a3-eea8-49da-ada9-c070748a354c tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:40.621231 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-afbfc442-0011-42a7-98e1-29bfc054f014 req-eddd83a3-eea8-49da-ada9-c070748a354c tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0480301 Sep 16 16:22:40.621860 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-80f1fa6c-2455-4673-ae27-6ce1d807504c req-73d657ba-baa7-4d50-ad14-d4f47bf5ef94 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2529008 Sep 16 16:22:40.660386 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-afbfc442-0011-42a7-98e1-29bfc054f014 req-8095bdff-3f50-4af7-b062-2e9f46d88d6e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333049 Sep 16 16:22:40.780371 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa215080-fba7-4e3a-8084-07746e857425 req-8037c837-e311-4349-a5d4-4b390ff0ac57 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:40.781810 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fa215080-fba7-4e3a-8084-07746e857425 req-8037c837-e311-4349-a5d4-4b390ff0ac57 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0508382 Sep 16 16:22:40.819357 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fa215080-fba7-4e3a-8084-07746e857425 req-0ce75a7d-b981-4d01-92c1-1662fa125de0 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314443 Sep 16 16:22:41.007482 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4172d5b1-a882-4313-aba0-54ac60ad9a67 req-e816952e-9f23-4fdd-8524-248a5fcd35d8 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:41.009258 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4172d5b1-a882-4313-aba0-54ac60ad9a67 req-e816952e-9f23-4fdd-8524-248a5fcd35d8 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0515492 Sep 16 16:22:41.046631 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4172d5b1-a882-4313-aba0-54ac60ad9a67 req-d83d41e5-ad8d-441f-bd15-11b1a09f5aa9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314763 Sep 16 16:22:41.337906 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982534c0-8b6a-415b-997c-64ac6b0cfd96 req-5603c57b-3dec-42a7-b63d-3f8eee0e01d1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:41.339370 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-982534c0-8b6a-415b-997c-64ac6b0cfd96 req-5603c57b-3dec-42a7-b63d-3f8eee0e01d1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0470910 Sep 16 16:22:41.380372 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-982534c0-8b6a-415b-997c-64ac6b0cfd96 req-818f5bed-1979-460d-810b-3dd67f81b125 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350730 Sep 16 16:22:41.792729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d99d5e-1319-4d65-bdd6-98ea328d1022 req-2e6283f9-2b87-47ac-97b6-24a3f90b671c tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:41.795694 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c3d99d5e-1319-4d65-bdd6-98ea328d1022 req-2e6283f9-2b87-47ac-97b6-24a3f90b671c tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0547817 Sep 16 16:22:41.835731 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c3d99d5e-1319-4d65-bdd6-98ea328d1022 req-d7f7f3ef-728b-4e2d-be18-549c36ae7245 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342195 Sep 16 16:22:41.944492 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7020d8e-ed6b-4441-ab43-d3f26b072ae9 req-8451a2ca-3eaa-4bca-a192-ef868be278d4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:41.945964 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b7020d8e-ed6b-4441-ab43-d3f26b072ae9 req-8451a2ca-3eaa-4bca-a192-ef868be278d4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 945 time: 0.0502169 Sep 16 16:22:41.982152 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b7020d8e-ed6b-4441-ab43-d3f26b072ae9 req-9405b262-9239-4299-a6d4-c5f40913c0d7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303106 Sep 16 16:22:42.146753 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:22:42.153319 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e42ecb5c-bf82-4da7-a301-2a3b2912db3d up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:42.163793 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3c6c8b-e92f-4aec-b4bc-900f58c679d7 req-fba63442-b2cb-40df-8090-66407edd4f53 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:42.165305 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bc3c6c8b-e92f-4aec-b4bc-900f58c679d7 req-fba63442-b2cb-40df-8090-66407edd4f53 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 944 time: 0.0506403 Sep 16 16:22:42.223077 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bc3c6c8b-e92f-4aec-b4bc-900f58c679d7 req-df4c2254-439f-4048-a4ca-47f346536fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515099 Sep 16 16:22:42.277461 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port e42ecb5c-bf82-4da7-a301-2a3b2912db3d completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:22:42.285769 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port e42ecb5c-bf82-4da7-a301-2a3b2912db3d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:42.286139 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.332797 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:42.351422 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'port_id': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'mac_address': 'fa:16:3e:d5:53:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 737, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:22:42.421122 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.437865 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.445451 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bffdae71-37f3-4fff-8a1f-24159107e4eb {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:42.482936 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:42.485291 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28b6f02d-cc10-43a5-adcc-bdbee31bc323" -d '{"events": [{"server_uuid": "4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d", "name": "network-vif-plugged", "status": "completed", "tag": "e42ecb5c-bf82-4da7-a301-2a3b2912db3d"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:42.501162 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:42.505205 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:42.507518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.554824 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fd8f6e6-4eb9-4dde-8be6-7f641c64f46a x-openstack-request-id: req-7fd8f6e6-4eb9-4dde-8be6-7f641c64f46a {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:42.555349 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d", "name": "network-vif-plugged", "status": "completed", "tag": "e42ecb5c-bf82-4da7-a301-2a3b2912db3d", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:42.555842 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-7fd8f6e6-4eb9-4dde-8be6-7f641c64f46a {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:42.556239 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d', 'code': 200} Sep 16 16:22:42.557082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.558254 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 4056f695-287f-45f7-bd60-21b6a8421280 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:42.569049 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e35a53b-6f6f-41e4-9bb1-a6fcfeff9685 req-7d021af5-9006-4fcb-a3c6-df9f32ed687c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:42.570760 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2e35a53b-6f6f-41e4-9bb1-a6fcfeff9685 req-7d021af5-9006-4fcb-a3c6-df9f32ed687c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0917740 Sep 16 16:22:42.634530 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2e35a53b-6f6f-41e4-9bb1-a6fcfeff9685 req-b1bc401e-e3c3-45d6-8023-7471c41780b4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565488 Sep 16 16:22:42.700047 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:42.770853 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port 4056f695-287f-45f7-bd60-21b6a8421280 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:22:42.777115 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1906e2f2-d9a9-44cd-a394-d7883121c2ef req-513ace5b-cd3e-4dc5-9583-1d746fff5bfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:42.778581 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1906e2f2-d9a9-44cd-a394-d7883121c2ef req-513ace5b-cd3e-4dc5-9583-1d746fff5bfc service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0385101 Sep 16 16:22:42.779397 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:42.781896 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port 4056f695-287f-45f7-bd60-21b6a8421280 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:42.782264 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.827993 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1906e2f2-d9a9-44cd-a394-d7883121c2ef req-b458500a-d895-46bf-8e6c-f330d759ce02 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414283 Sep 16 16:22:42.853486 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['bffdae71-37f3-4fff-8a1f-24159107e4eb'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:22:42.895322 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:42.968310 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 4056f695-287f-45f7-bd60-21b6a8421280, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=4056f695-287f-45f7-bd60-21b6a8421280,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:42.971411 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8ff6a4-c0ae-46a8-99d8-71839f5d7d2f req-c35f28be-bbb0-410a-a5b3-c9678baf0e56 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:42.972963 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1a8ff6a4-c0ae-46a8-99d8-71839f5d7d2f req-c35f28be-bbb0-410a-a5b3-c9678baf0e56 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0616865 Sep 16 16:22:42.980461 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:43.054832 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1a8ff6a4-c0ae-46a8-99d8-71839f5d7d2f req-2ad3d2ce-0aed-4617-befc-0dc2570754e3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687368 Sep 16 16:22:43.077474 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=4056f695-287f-45f7-bd60-21b6a8421280,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:43.145268 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a98740f-be7b-409f-b96c-b2c32104a1d8 req-f327d1c1-53ad-4199-bdfe-f07f88109786 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:43.147473 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a98740f-be7b-409f-b96c-b2c32104a1d8 req-f327d1c1-53ad-4199-bdfe-f07f88109786 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0613096 Sep 16 16:22:43.208586 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a98740f-be7b-409f-b96c-b2c32104a1d8 req-28454b0b-6452-403b-9456-a0a2a9070251 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545418 Sep 16 16:22:43.352680 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21b09a3-a355-4196-bc49-78870bd970ae req-a67ba26c-a33d-45c7-a26b-ee7992c99c22 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:43.360881 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b21b09a3-a355-4196-bc49-78870bd970ae req-a67ba26c-a33d-45c7-a26b-ee7992c99c22 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 945 time: 0.0613794 Sep 16 16:22:43.403159 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b21b09a3-a355-4196-bc49-78870bd970ae req-48e6424e-2fc3-4c22-aca2-1f70c3476570 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413177 Sep 16 16:22:44.158366 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:22:44.229399 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port bffdae71-37f3-4fff-8a1f-24159107e4eb completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:22:44.234034 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port bffdae71-37f3-4fff-8a1f-24159107e4eb triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:22:44.234399 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:44.344110 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:44.366720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac34ce6-4114-4776-9496-44e0ae49d366 req-953f6c46-228b-48c1-be4b-71aa11bbc732 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:44.371149 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fac34ce6-4114-4776-9496-44e0ae49d366 req-953f6c46-228b-48c1-be4b-71aa11bbc732 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0752735 Sep 16 16:22:44.383853 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:22:44.388922 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:44.413422 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fac34ce6-4114-4776-9496-44e0ae49d366 req-eb8af2c8-99fe-48f0-abfc-0ed804007e93 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342736 Sep 16 16:22:44.444779 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:44.557837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4056f695-287f-45f7-bd60-21b6a8421280'}, {'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:44.558625 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b97d7e7-7648-43fa-aaa6-4ec4b6c3990f req-f892720c-b36a-4360-b92f-6c5fce1e6f5e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:44.560572 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3b97d7e7-7648-43fa-aaa6-4ec4b6c3990f req-f892720c-b36a-4360-b92f-6c5fce1e6f5e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0587163 Sep 16 16:22:44.561163 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-def64835-ac96-4d07-828e-5a0ad949e1d8" -d '{"events": [{"server_uuid": "f4270a41-8af0-4e57-9dc8-15227e6ab264", "name": "network-vif-plugged", "status": "completed", "tag": "4056f695-287f-45f7-bd60-21b6a8421280"}, {"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-plugged", "status": "completed", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:44.625393 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31b03c7b-f991-4e7e-be0e-4f98b4f23bf1 x-openstack-request-id: req-31b03c7b-f991-4e7e-be0e-4f98b4f23bf1 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:44.625876 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4270a41-8af0-4e57-9dc8-15227e6ab264", "name": "network-vif-plugged", "status": "completed", "tag": "4056f695-287f-45f7-bd60-21b6a8421280", "code": 200}, {"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-plugged", "status": "completed", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:44.626319 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-31b03c7b-f991-4e7e-be0e-4f98b4f23bf1 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:44.627291 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4056f695-287f-45f7-bd60-21b6a8421280', 'code': 200} Sep 16 16:22:44.627990 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'code': 200} Sep 16 16:22:44.632731 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3b97d7e7-7648-43fa-aaa6-4ec4b6c3990f req-a682875d-9681-4e4a-8e86-e1bd0d2212c4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0642006 Sep 16 16:22:44.957536 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95bc607f-6639-4839-b731-336c96e6cb62 req-c52b2b85-8b55-4a1f-896b-109a3df1ddcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:44.959485 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-95bc607f-6639-4839-b731-336c96e6cb62 req-c52b2b85-8b55-4a1f-896b-109a3df1ddcd service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 1099 time: 0.0527127 Sep 16 16:22:44.986852 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c234ff8-5ab3-40a3-85c1-6c2bb983345b req-3f5b8c23-e4ab-43f7-be5c-7708adf57803 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:44.988633 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3c234ff8-5ab3-40a3-85c1-6c2bb983345b req-3f5b8c23-e4ab-43f7-be5c-7708adf57803 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1099 time: 0.0740879 Sep 16 16:22:45.028442 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-95bc607f-6639-4839-b731-336c96e6cb62 req-57792f69-2c5a-4ba6-acec-aa54a4e5d20c service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609186 Sep 16 16:22:45.046343 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3c234ff8-5ab3-40a3-85c1-6c2bb983345b req-842a482f-a3ae-48fd-bcbc-bec79046bea0 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448859 Sep 16 16:22:45.095298 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.304414 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35822) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:45.429986 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b840a353-11b3-4e24-918d-34728eb3e41b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.546115 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b840a353-11b3-4e24-918d-34728eb3e41b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.550517 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b840a353-11b3-4e24-918d-34728eb3e41b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.559886 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9db59ac-c4ee-45ff-86f9-50ea5487a0b4 req-3cf38a47-9d4f-4fae-abb9-16adc01608c5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:45.562438 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e9db59ac-c4ee-45ff-86f9-50ea5487a0b4 req-3cf38a47-9d4f-4fae-abb9-16adc01608c5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0646622 Sep 16 16:22:45.595895 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-b840a353-11b3-4e24-918d-34728eb3e41b admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=293045fd9e7e435281e7bd5a705f65a3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2900262 Sep 16 16:22:45.596913 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35842) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:45.598294 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b840a353-11b3-4e24-918d-34728eb3e41b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3ebc009-431a-4476-87e1-033940ae3917,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:45.608922 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e9db59ac-c4ee-45ff-86f9-50ea5487a0b4 req-cfb93913-1077-4c9d-8e7b-f31efb50f1bc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393863 Sep 16 16:22:45.651800 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68279c1f-a3c8-49ef-b690-499248d68f97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.673767 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68279c1f-a3c8-49ef-b690-499248d68f97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.786503 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c449938d-9272-4b5e-82ae-00e586726c7c req-d41ddfa0-5dc9-43e6-b5d0-4050a759cfac tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:45.788040 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c449938d-9272-4b5e-82ae-00e586726c7c req-d41ddfa0-5dc9-43e6-b5d0-4050a759cfac tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0660684 Sep 16 16:22:45.792121 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68279c1f-a3c8-49ef-b690-499248d68f97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.794816 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68279c1f-a3c8-49ef-b690-499248d68f97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:45.798861 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-68279c1f-a3c8-49ef-b690-499248d68f97 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b3ebc009-431a-4476-87e1-033940ae3917 HTTP/1.1" status: 204 len: 168 time: 0.1981676 Sep 16 16:22:45.812272 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68279c1f-a3c8-49ef-b690-499248d68f97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3ebc009-431a-4476-87e1-033940ae3917,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:45.863461 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c449938d-9272-4b5e-82ae-00e586726c7c req-b2397dea-48a3-4ff6-af93-f851d870643c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0662935 Sep 16 16:22:46.111171 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35858) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:46.125104 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-30125b45-7a3d-49ca-a9ac-6bda34f81491 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.215256 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-30125b45-7a3d-49ca-a9ac-6bda34f81491 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.219046 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-30125b45-7a3d-49ca-a9ac-6bda34f81491 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.255784 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-30125b45-7a3d-49ca-a9ac-6bda34f81491 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=2e33b06171504fe5874dac22fdcf7d4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1435018 Sep 16 16:22:46.257674 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30125b45-7a3d-49ca-a9ac-6bda34f81491 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e169fafd-ae7a-4382-8a52-4c1fe50c5cf7,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:46.258612 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35866) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:46.311294 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfd67-4b30-4f90-a182-8049d4a0ad33 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.335384 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfd67-4b30-4f90-a182-8049d4a0ad33 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.382433 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfd67-4b30-4f90-a182-8049d4a0ad33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.384990 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfd67-4b30-4f90-a182-8049d4a0ad33 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.386168 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c9bbfd67-4b30-4f90-a182-8049d4a0ad33 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e169fafd-ae7a-4382-8a52-4c1fe50c5cf7 HTTP/1.1" status: 204 len: 168 time: 0.1256690 Sep 16 16:22:46.393836 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9bbfd67-4b30-4f90-a182-8049d4a0ad33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e169fafd-ae7a-4382-8a52-4c1fe50c5cf7,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:46.417378 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35872) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:46.543240 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-220508e7-35bb-4746-ae30-67c4a19217c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.695473 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-220508e7-35bb-4746-ae30-67c4a19217c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.701493 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-220508e7-35bb-4746-ae30-67c4a19217c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.756433 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-220508e7-35bb-4746-ae30-67c4a19217c0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c6b035d527b84ec684ecb80577b48561&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3377075 Sep 16 16:22:46.759120 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35896) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:46.793688 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36a42fb-4466-4968-adbb-aae2306873de req-d50f9021-3181-4cd3-9898-cae3e4e6d5ed tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:46.795223 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c36a42fb-4466-4968-adbb-aae2306873de req-d50f9021-3181-4cd3-9898-cae3e4e6d5ed tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0858181 Sep 16 16:22:46.795974 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-220508e7-35bb-4746-ae30-67c4a19217c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8b296ab-97da-419a-a712-600bd12b9902,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:46.889828 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c36a42fb-4466-4968-adbb-aae2306873de req-d53267e9-5be1-4ae8-8be5-1ff9a931b452 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742137 Sep 16 16:22:46.911834 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5640-f285-44bd-8968-16fb2580a240 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:46.983597 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5640-f285-44bd-8968-16fb2580a240 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.083048 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-624f799b-2015-481f-bf4b-46ff85244985 req-14b661a3-0510-4935-888e-88a8f5742d1c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:47.092737 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-624f799b-2015-481f-bf4b-46ff85244985 req-14b661a3-0510-4935-888e-88a8f5742d1c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0882237 Sep 16 16:22:47.102538 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5640-f285-44bd-8968-16fb2580a240 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.105495 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5640-f285-44bd-8968-16fb2580a240 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.110120 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a5ff5640-f285-44bd-8968-16fb2580a240 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a8b296ab-97da-419a-a712-600bd12b9902 HTTP/1.1" status: 204 len: 168 time: 0.3498290 Sep 16 16:22:47.125698 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ff5640-f285-44bd-8968-16fb2580a240 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8b296ab-97da-419a-a712-600bd12b9902,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:47.162572 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-624f799b-2015-481f-bf4b-46ff85244985 req-bcdd77d0-3d99-4338-8108-75d195a6a663 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0671253 Sep 16 16:22:47.328430 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f97a61-ed1b-463c-be43-d1fefb12b1cc req-8281273b-e017-4778-8c02-c7dfc04da155 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:47.330043 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-56f97a61-ed1b-463c-be43-d1fefb12b1cc req-8281273b-e017-4778-8c02-c7dfc04da155 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0506606 Sep 16 16:22:47.370012 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-56f97a61-ed1b-463c-be43-d1fefb12b1cc req-561119a9-fe50-4785-92af-c896cd136ff8 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332134 Sep 16 16:22:47.504522 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35936) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:47.518215 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f517bdaf-1114-434b-97b4-6613b48321c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.608516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f517bdaf-1114-434b-97b4-6613b48321c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.612938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f517bdaf-1114-434b-97b4-6613b48321c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.649892 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f517bdaf-1114-434b-97b4-6613b48321c8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=d3e6416ab7164f3fa83da3e9b30e104c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1442993 Sep 16 16:22:47.650828 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f517bdaf-1114-434b-97b4-6613b48321c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d91e388e-c74d-4feb-be7e-d7394b428e8f,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:47.652693 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35940) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:47.715954 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-98519f5e-4bd2-459c-b0ee-dddb39235fe2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.737213 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-98519f5e-4bd2-459c-b0ee-dddb39235fe2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.787830 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-98519f5e-4bd2-459c-b0ee-dddb39235fe2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.790437 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-98519f5e-4bd2-459c-b0ee-dddb39235fe2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:47.791623 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-98519f5e-4bd2-459c-b0ee-dddb39235fe2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d91e388e-c74d-4feb-be7e-d7394b428e8f HTTP/1.1" status: 204 len: 168 time: 0.1355770 Sep 16 16:22:47.800345 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98519f5e-4bd2-459c-b0ee-dddb39235fe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d91e388e-c74d-4feb-be7e-d7394b428e8f,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:48.123025 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35966) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:48.135757 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0544749c-0d1c-4cc1-9781-f2dd785e9ecb admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.242773 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0544749c-0d1c-4cc1-9781-f2dd785e9ecb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.247304 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0544749c-0d1c-4cc1-9781-f2dd785e9ecb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.299440 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0544749c-0d1c-4cc1-9781-f2dd785e9ecb admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=14bdc6cb351746c4bb347a3224aacd3a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1730170 Sep 16 16:22:48.299632 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bdc3088-e82e-4641-9eba-d4cecc2b530d req-b941fffd-9001-46a3-b0f8-35940eb40147 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:48.300091 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0544749c-0d1c-4cc1-9781-f2dd785e9ecb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38405abf-023c-4d07-b0f4-7807769bd5c1,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:48.302969 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 35980) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:48.317748 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2bdc3088-e82e-4641-9eba-d4cecc2b530d req-b941fffd-9001-46a3-b0f8-35940eb40147 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0675635 Sep 16 16:22:48.360846 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-db5bb74f-bb26-4f68-8959-6f193f98df3a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.370040 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2bdc3088-e82e-4641-9eba-d4cecc2b530d req-ee7f0d03-f8b4-4436-9572-ecd7f265faea tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447419 Sep 16 16:22:48.387301 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-db5bb74f-bb26-4f68-8959-6f193f98df3a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.446309 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-db5bb74f-bb26-4f68-8959-6f193f98df3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.450005 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-db5bb74f-bb26-4f68-8959-6f193f98df3a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:48.451327 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-db5bb74f-bb26-4f68-8959-6f193f98df3a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/38405abf-023c-4d07-b0f4-7807769bd5c1 HTTP/1.1" status: 204 len: 168 time: 0.1472821 Sep 16 16:22:48.462181 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5bb74f-bb26-4f68-8959-6f193f98df3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38405abf-023c-4d07-b0f4-7807769bd5c1,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:48.522061 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905ffa2f-55ce-4e67-aa37-2c306606c3f0 req-89e318bd-7320-4f5c-804e-555586fee595 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:48.524336 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-905ffa2f-55ce-4e67-aa37-2c306606c3f0 req-89e318bd-7320-4f5c-804e-555586fee595 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0717118 Sep 16 16:22:48.569142 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-905ffa2f-55ce-4e67-aa37-2c306606c3f0 req-66f40b19-09b0-4747-aca7-a2155b152635 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366039 Sep 16 16:22:48.574687 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dba0b0-4300-4afa-9f92-400d00f4fb88 req-bcf4c73e-2ff2-4e70-aa49-9031e39874e4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:48.576313 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-36dba0b0-4300-4afa-9f92-400d00f4fb88 req-bcf4c73e-2ff2-4e70-aa49-9031e39874e4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0752044 Sep 16 16:22:48.584886 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 35990) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:48.590036 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'floatingip': {'port_id': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:48.671542 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:49.301226 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:49.305575 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:49.592659 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.l3_db [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Floating IP 55845680-24fb-4140-822e-5f3b77e51725 associated. External IP: 172.27.3.73, port: bffdae71-37f3-4fff-8a1f-24159107e4eb. Sep 16 16:22:49.690798 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c57793c-076c-4294-9d66-24f9557a4169 req-30e1814c-a27a-4e14-84c8-85808ca46676 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:49.693302 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0c57793c-076c-4294-9d66-24f9557a4169 req-30e1814c-a27a-4e14-84c8-85808ca46676 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0514848 Sep 16 16:22:49.731746 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0c57793c-076c-4294-9d66-24f9557a4169 req-51948e01-eb85-4ffa-a036-18ba47f6c47a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318151 Sep 16 16:22:49.806143 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Router da1aab41-d805-4a4f-a252-59e579ace211 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:22:49.918489 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:22:49.923092 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:49.931716 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:22:49.942911 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:49.944243 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:22:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:49.956379 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1cb48902-04a3-427e-93b1-e97abcd6d4e7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "PUT /v2.0/floatingips/55845680-24fb-4140-822e-5f3b77e51725 HTTP/1.1" status: 200 len: 991 time: 1.3703887 Sep 16 16:22:49.957176 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:49.963613 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-199499a1-1e92-41ae-ae0b-2d564bf96a4e" -d '{"events": [{"name": "network-changed", "server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:50.015309 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8b875a1-793e-43b9-a64d-efab6f0bb36b x-openstack-request-id: req-d8b875a1-793e-43b9-a64d-efab6f0bb36b {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:50.015600 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:50.015858 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-d8b875a1-793e-43b9-a64d-efab6f0bb36b {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:50.016260 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'status': 'completed', 'code': 200} Sep 16 16:22:50.072067 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:50.133259 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-946278a2-05d1-4a33-8dcc-fb3f345c2c4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.135060 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-946278a2-05d1-4a33-8dcc-fb3f345c2c4f service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1099 time: 0.0488491 Sep 16 16:22:50.141319 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-b099d131-c994-4e75-afd8-748b59b5b526 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.143528 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-b099d131-c994-4e75-afd8-748b59b5b526 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 1099 time: 0.0667226 Sep 16 16:22:50.258594 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-6e1c9d35-5735-4f74-8316-1bff8ae2eeb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.260529 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-6e1c9d35-5735-4f74-8316-1bff8ae2eeb5 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.1179233 Sep 16 16:22:50.287611 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-6c4ef9a8-9f4d-448d-a900-6ee516cca796 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.289354 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-6c4ef9a8-9f4d-448d-a900-6ee516cca796 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.1392822 Sep 16 16:22:50.307522 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36066) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:50.347390 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-c6ca0ca1-188e-4181-9219-2c06144b6e5a service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4056f695-287f-45f7-bd60-21b6a8421280 HTTP/1.1" status: 200 len: 217 time: 0.0479980 Sep 16 16:22:50.380674 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-85dc325c-b549-4884-ba30-eed5308b9b1e service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 999 time: 0.1055830 Sep 16 16:22:50.422048 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-691e8898-2576-45e2-a128-9739d0e6440f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.423870 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-691e8898-2576-45e2-a128-9739d0e6440f service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0698307 Sep 16 16:22:50.443756 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-9be4634c-25b2-4ef2-92a5-42cc45d987cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.445320 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-9be4634c-25b2-4ef2-92a5-42cc45d987cb service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0534127 Sep 16 16:22:50.450653 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '55845680-24fb-4140-822e-5f3b77e51725', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'floating_ip_address': '172.27.3.73', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'port_id': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'mac_address': 'fa:16:3e:d5:53:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:22:24Z', 'updated_at': '2021-09-16T16:22:49Z', 'revision_number': 1, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:50.457138 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-399706af-7735-45a2-89ac-719fd7200aa9 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0255523 Sep 16 16:22:50.476958 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:22:50.485846 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:22:50.486486 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:22:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:50.500019 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-c79486a9-8e33-4ff3-ac9c-1da57804d183 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.501532 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-c79486a9-8e33-4ff3-ac9c-1da57804d183 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0494609 Sep 16 16:22:50.513479 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b25f4d57-df3e-4d12-96b8-b1e22aa606e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.619700 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:22:50.620692 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-bb9189ef-9732-4aea-98ef-93c91a5f2f1e service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1111302 Sep 16 16:22:50.624809 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-69296dea-d590-41da-a7bd-91f3649ea520 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1592042 Sep 16 16:22:50.729348 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2c3a9dae-48a0-418a-b4fd-5ead21e2e5ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.767888 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b25f4d57-df3e-4d12-96b8-b1e22aa606e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.779881 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-b25f4d57-df3e-4d12-96b8-b1e22aa606e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.787314 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-199499a1-1e92-41ae-ae0b-2d564bf96a4e req-66b4e422-1566-4536-bd37-e81b62e988a1 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1530676 Sep 16 16:22:50.819103 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-86902c68-e9cf-4bfe-b024-db929f844fa6 req-c17a920d-ee51-4f86-99ce-a77691d8e8f2 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1604218 Sep 16 16:22:50.837140 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36094) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:50.837473 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-b25f4d57-df3e-4d12-96b8-b1e22aa606e6 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=b3b3d07c4c914c1a89d14a81556fc077&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5294256 Sep 16 16:22:50.842743 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25f4d57-df3e-4d12-96b8-b1e22aa606e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed3404a7-d299-4647-b1bb-ff6d0761d5ac,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:50.907735 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-211b19d7-f242-46d2-99e8-76b6ee2b053a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.932325 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-211b19d7-f242-46d2-99e8-76b6ee2b053a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.953468 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8aafa6-6613-43c1-b7c8-c98e11683e38 req-f3817ff0-0004-4490-ae37-98d33ef7293e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:50.955583 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '55845680-24fb-4140-822e-5f3b77e51725', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'floating_ip_address': '172.27.3.73', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'port_id': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'mac_address': 'fa:16:3e:d5:53:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:22:24Z', 'updated_at': '2021-09-16T16:22:49Z', 'revision_number': 1, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:22:50.956692 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4f8aafa6-6613-43c1-b7c8-c98e11683e38 req-f3817ff0-0004-4490-ae37-98d33ef7293e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0852048 Sep 16 16:22:50.996033 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-211b19d7-f242-46d2-99e8-76b6ee2b053a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.998647 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-211b19d7-f242-46d2-99e8-76b6ee2b053a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:50.999894 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-211b19d7-f242-46d2-99e8-76b6ee2b053a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/ed3404a7-d299-4647-b1bb-ff6d0761d5ac HTTP/1.1" status: 204 len: 168 time: 0.1616197 Sep 16 16:22:51.013428 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc9051c6-637b-4e94-b92c-5d2cf7670e9f None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '55845680-24fb-4140-822e-5f3b77e51725', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'floating_ip_address': '172.27.3.73', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'port_id': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'mac_address': 'fa:16:3e:d5:53:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:22:24Z', 'updated_at': '2021-09-16T16:22:49Z', 'revision_number': 1, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:22:51.014425 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4f8aafa6-6613-43c1-b7c8-c98e11683e38 req-6c223137-dd0c-4a10-87c2-e413ea19a3b3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474365 Sep 16 16:22:51.024119 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-211b19d7-f242-46d2-99e8-76b6ee2b053a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed3404a7-d299-4647-b1bb-ff6d0761d5ac,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:51.332057 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45b6bb85-eedd-459f-8e22-8775ff9844de None None] New status for floating IP 55845680-24fb-4140-822e-5f3b77e51725: ACTIVE {{(pid=93952) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:22:51.371033 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36138) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:51.386668 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5854a8e3-cb3c-4070-ac5e-cef384470c78 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.479351 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5854a8e3-cb3c-4070-ac5e-cef384470c78 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.483541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5854a8e3-cb3c-4070-ac5e-cef384470c78 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.524790 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5854a8e3-cb3c-4070-ac5e-cef384470c78 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=b0801ed0a5d64871b60647175dae621e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1526127 Sep 16 16:22:51.527363 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36142) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:51.534258 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5854a8e3-cb3c-4070-ac5e-cef384470c78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fcc4a75f-f3f7-4a98-9c04-6dd2fb385b37,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:51.581490 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6ff23fc5-7a82-45d6-80e7-031e7c1c0e7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.601993 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6ff23fc5-7a82-45d6-80e7-031e7c1c0e7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.648610 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6ff23fc5-7a82-45d6-80e7-031e7c1c0e7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.651163 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6ff23fc5-7a82-45d6-80e7-031e7c1c0e7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:51.655130 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-6ff23fc5-7a82-45d6-80e7-031e7c1c0e7f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/fcc4a75f-f3f7-4a98-9c04-6dd2fb385b37 HTTP/1.1" status: 204 len: 168 time: 0.1243820 Sep 16 16:22:51.665811 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff23fc5-7a82-45d6-80e7-031e7c1c0e7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcc4a75f-f3f7-4a98-9c04-6dd2fb385b37,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:52.170426 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb674f4b-6b38-4b41-bb6c-2ce5d396bb2e req-662184ac-45d9-42de-8468-b0558da7527f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:52.171899 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fb674f4b-6b38-4b41-bb6c-2ce5d396bb2e req-662184ac-45d9-42de-8468-b0558da7527f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0541823 Sep 16 16:22:52.214391 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fb674f4b-6b38-4b41-bb6c-2ce5d396bb2e req-15fc6869-f158-441d-8f98-056efb347538 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367148 Sep 16 16:22:52.654713 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36214) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:52.781879 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ef9dba42-9065-45b4-83b6-603fafac67b0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:52.883590 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ef9dba42-9065-45b4-83b6-603fafac67b0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:52.888598 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ef9dba42-9065-45b4-83b6-603fafac67b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:52.960216 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-ef9dba42-9065-45b4-83b6-603fafac67b0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=4cff6ca521e644fe909a1fb63acc691b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3043680 Sep 16 16:22:52.965042 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36236) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:52.978269 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9dba42-9065-45b4-83b6-603fafac67b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1e1b2f8-c7a7-4de0-afdb-706340840183,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:53.061970 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ba6cfb9c-bdaf-4064-8aaa-2dbe666e0a93 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.094908 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ba6cfb9c-bdaf-4064-8aaa-2dbe666e0a93 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.140503 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ba6cfb9c-bdaf-4064-8aaa-2dbe666e0a93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.143005 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ba6cfb9c-bdaf-4064-8aaa-2dbe666e0a93 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.146516 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-ba6cfb9c-bdaf-4064-8aaa-2dbe666e0a93 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d1e1b2f8-c7a7-4de0-afdb-706340840183 HTTP/1.1" status: 204 len: 168 time: 0.1790819 Sep 16 16:22:53.151839 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6cfb9c-bdaf-4064-8aaa-2dbe666e0a93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1e1b2f8-c7a7-4de0-afdb-706340840183,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:53.338257 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a8e7b7-fb5d-4270-b6e8-37fff8b4b0e8 req-ab985fe6-a6f6-4011-bbd8-c6597a60e394 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:53.339866 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e4a8e7b7-fb5d-4270-b6e8-37fff8b4b0e8 req-ab985fe6-a6f6-4011-bbd8-c6597a60e394 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0562654 Sep 16 16:22:53.397595 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e4a8e7b7-fb5d-4270-b6e8-37fff8b4b0e8 req-89bdef9b-4603-46eb-9040-5fb666472616 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504773 Sep 16 16:22:53.445266 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0bc53eaf-e19c-4e67-b6ee-085bb1952d2a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.554134 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36268) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:53.577193 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cc7c6016-eae9-4d94-b78d-63b237ca2a51 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.701195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cc7c6016-eae9-4d94-b78d-63b237ca2a51 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.707918 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cc7c6016-eae9-4d94-b78d-63b237ca2a51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.719136 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.744598 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-cc7c6016-eae9-4d94-b78d-63b237ca2a51 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=1993dae47e1f49459104b0aa083fb54f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1883454 Sep 16 16:22:53.747466 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36280) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:53.753887 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc7c6016-eae9-4d94-b78d-63b237ca2a51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48a16ff9-c5d2-4901-b422-7609d98c4b1d,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:53.813224 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-acabe124-f3fe-46fa-8368-18349ef35c81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.836453 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-acabe124-f3fe-46fa-8368-18349ef35c81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.893767 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-acabe124-f3fe-46fa-8368-18349ef35c81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.896626 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-acabe124-f3fe-46fa-8368-18349ef35c81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:53.900462 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-acabe124-f3fe-46fa-8368-18349ef35c81 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/48a16ff9-c5d2-4901-b422-7609d98c4b1d HTTP/1.1" status: 204 len: 168 time: 0.1484635 Sep 16 16:22:53.907820 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acabe124-f3fe-46fa-8368-18349ef35c81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48a16ff9-c5d2-4901-b422-7609d98c4b1d,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:54.033756 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-e7feb838-f540-4c61-b624-241fbf86f571 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:54.035416 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-e7feb838-f540-4c61-b624-241fbf86f571 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.1113191 Sep 16 16:22:54.050998 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-4ee3d29a-f4c9-4f58-a5aa-50dbe4dca2b4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/quotas/0378b53234de487d8ebc6eeb3fbfbe5d HTTP/1.1" status: 200 len: 375 time: 0.0097098 Sep 16 16:22:54.111670 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-9938950f-1add-40aa-a0f6-5d33957fde33 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0532997 Sep 16 16:22:54.350546 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:54.392037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-04c23243-ed97-4688-b4ed-05439d9af41d service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2711184 Sep 16 16:22:54.422464 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36334) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:54.525199 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a4810475-bb26-4f2d-9453-2c06561d5190 service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248624 Sep 16 16:22:54.554786 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-907a7ae7-08b7-423f-8826-b6eb58f4c5f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:54.567941 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cee1b32-fd06-41f3-9ce5-0b2f11b08375 req-6f7c3401-fdd4-4d8e-9b62-5d53607f9c9a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:54.569667 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7cee1b32-fd06-41f3-9ce5-0b2f11b08375 req-6f7c3401-fdd4-4d8e-9b62-5d53607f9c9a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0768459 Sep 16 16:22:54.644553 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7cee1b32-fd06-41f3-9ce5-0b2f11b08375 req-13a5549c-e662-457f-acb1-a7ef688d403a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661333 Sep 16 16:22:54.775618 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f9d6357d-3808-4b79-8f43-1f45e7ac2120 req-ff2bd995-d38e-4435-8ab5-f460d290d030 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 210 time: 0.0781350 Sep 16 16:22:54.829143 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-907a7ae7-08b7-423f-8826-b6eb58f4c5f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:54.836318 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-907a7ae7-08b7-423f-8826-b6eb58f4c5f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:54.866781 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-907a7ae7-08b7-423f-8826-b6eb58f4c5f7 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=e08882f719fb4dd18b28d99309285a09&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4433711 Sep 16 16:22:54.869590 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36374) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:54.923880 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-907a7ae7-08b7-423f-8826-b6eb58f4c5f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bf208f5-42f8-45a0-b999-0286a63f7488,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:54.945322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-49fdb10c-08b6-404c-aa4c-ab152793b0d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:54.983420 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-49fdb10c-08b6-404c-aa4c-ab152793b0d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.048221 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-49fdb10c-08b6-404c-aa4c-ab152793b0d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.051697 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-49fdb10c-08b6-404c-aa4c-ab152793b0d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.056622 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-49fdb10c-08b6-404c-aa4c-ab152793b0d2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8bf208f5-42f8-45a0-b999-0286a63f7488 HTTP/1.1" status: 204 len: 168 time: 0.1859288 Sep 16 16:22:55.065577 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fdb10c-08b6-404c-aa4c-ab152793b0d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bf208f5-42f8-45a0-b999-0286a63f7488,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:55.487127 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36412) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:55.501013 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1677429-eb9f-4790-bc82-9ac977cb3928 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.532033 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36414) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:55.593382 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1677429-eb9f-4790-bc82-9ac977cb3928 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.599080 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f1677429-eb9f-4790-bc82-9ac977cb3928 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.641084 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-f1677429-eb9f-4790-bc82-9ac977cb3928 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=8f694a5483a34d48bee67e5eaa200064&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1504340 Sep 16 16:22:55.641402 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36422) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:55.644781 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1677429-eb9f-4790-bc82-9ac977cb3928 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ad3a4fd-c266-4179-97b3-b67c5ef72a48,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:55.697347 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0cd92888-e8b1-4428-ab41-b5fb109143bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.720772 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fc782317-e905-4acf-bb44-3cad32e4d686 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.755111 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0cd92888-e8b1-4428-ab41-b5fb109143bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.869505 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95cb7e2-4ce6-46ac-8789-810a0612af09 req-3f4c677a-3cfc-43b8-9c82-41f463906abe tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:55.875917 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95cb7e2-4ce6-46ac-8789-810a0612af09 req-3f4c677a-3cfc-43b8-9c82-41f463906abe tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.1416326 Sep 16 16:22:55.888177 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-aaae8ded-fb49-45f6-8757-fe85d0045ca0 req-47bb0b72-d09b-4bff-b619-753b9eca6a46 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 210 time: 0.0286810 Sep 16 16:22:55.956715 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fc782317-e905-4acf-bb44-3cad32e4d686 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.967728 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fc782317-e905-4acf-bb44-3cad32e4d686 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.996064 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0cd92888-e8b1-4428-ab41-b5fb109143bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:55.999826 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0cd92888-e8b1-4428-ab41-b5fb109143bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.003672 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0cd92888-e8b1-4428-ab41-b5fb109143bf admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7ad3a4fd-c266-4179-97b3-b67c5ef72a48 HTTP/1.1" status: 204 len: 168 time: 0.3612859 Sep 16 16:22:56.035821 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc782317-e905-4acf-bb44-3cad32e4d686 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd7ffe29-4690-47c8-98af-cd6210800510,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:56.061175 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-424b4959-7152-498f-af04-0e85fd542895 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:56.062715 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-424b4959-7152-498f-af04-0e85fd542895 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.1695349 Sep 16 16:22:56.080904 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Request body: {'port': {'device_id': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'admin_state_up': True, 'tenant_id': '0378b53234de487d8ebc6eeb3fbfbe5d'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:56.097568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd92888-e8b1-4428-ab41-b5fb109143bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ad3a4fd-c266-4179-97b3-b67c5ef72a48,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:56.109977 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95cb7e2-4ce6-46ac-8789-810a0612af09 req-fd707d4b-9a6c-47e9-abb3-f3a0cb8bd7c6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1806941 Sep 16 16:22:56.121373 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-fc782317-e905-4acf-bb44-3cad32e4d686 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=815dc1c7fbd94a32b3dfdebab8db54e2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5816395 Sep 16 16:22:56.123301 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36446) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:56.169726 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.227948 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3afb5ff3-b754-41ba-ab11-2a6f3c915d55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.261663 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3afb5ff3-b754-41ba-ab11-2a6f3c915d55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.271327 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Made reservation on behalf of 0378b53234de487d8ebc6eeb3fbfbe5d for: {'port': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:22:56.277276 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.332816 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3afb5ff3-b754-41ba-ab11-2a6f3c915d55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.336052 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3afb5ff3-b754-41ba-ab11-2a6f3c915d55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.339833 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3afb5ff3-b754-41ba-ab11-2a6f3c915d55 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/cd7ffe29-4690-47c8-98af-cd6210800510 HTTP/1.1" status: 204 len: 168 time: 0.2102661 Sep 16 16:22:56.345372 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3afb5ff3-b754-41ba-ab11-2a6f3c915d55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd7ffe29-4690-47c8-98af-cd6210800510,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:56.405406 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36458) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:56.433835 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Allocated IP 172.20.0.6 (143ad357-dcc1-47a6-a228-62d36164e62c/57a636e1-0951-4c2f-8be2-8ca36acb1d05/ec91d974-1df8-4ab5-991b-161fcd90cf2d) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:22:56.607659 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.645611 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.660590 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:22:56.692098 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Network 143ad357-dcc1-47a6-a228-62d36164e62c is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:22:56.695434 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:22:56.699604 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:22:56.714445 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36470) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:56.731020 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event updated for resources: {'Port': ['ID=ec91d974-1df8-4ab5-991b-161fcd90cf2d,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:56.747961 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8d68b235-d126-4ca5-b6eb-8d0b5ee958cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.766324 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:56.766962 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.859936 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8f8a15da-0ecb-4b58-8f14-4a51e3375a6c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.913400 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8d68b235-d126-4ca5-b6eb-8d0b5ee958cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.919333 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8d68b235-d126-4ca5-b6eb-8d0b5ee958cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.930172 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-a97518d2-2b26-452e-a8b2-ff7be1c0def2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8570218 Sep 16 16:22:56.944194 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Request body: {'port': {'device_id': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:22:56.948255 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36482) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:56.953337 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d68b235-d126-4ca5-b6eb-8d0b5ee958cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87de4490-d704-4532-be66-da61de0817f8,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:56.996565 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8d68b235-d126-4ca5-b6eb-8d0b5ee958cb admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=467ccf14763845108e15f53301436e68&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5877054 Sep 16 16:22:56.996789 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-932b503d-9abb-473b-a4c2-df7ac2aa17da admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:56.998391 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36484) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:57.069299 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.073734 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e418e97e-1672-480f-88e4-3e6cd52c891e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.092867 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b561030-cd65-48bf-ace6-2e1baaaf80eb req-6cbee680-0f3b-4157-a22f-66cfc0170d12 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:57.094427 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1b561030-cd65-48bf-ace6-2e1baaaf80eb req-6cbee680-0f3b-4157-a22f-66cfc0170d12 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 931 time: 0.1045876 Sep 16 16:22:57.104309 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e418e97e-1672-480f-88e4-3e6cd52c891e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.160437 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8f8a15da-0ecb-4b58-8f14-4a51e3375a6c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.169086 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8f8a15da-0ecb-4b58-8f14-4a51e3375a6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.228373 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1b561030-cd65-48bf-ace6-2e1baaaf80eb req-0bbd7e52-8e81-4a07-96bd-34155e9a2062 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1111290 Sep 16 16:22:57.233014 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e418e97e-1672-480f-88e4-3e6cd52c891e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.235856 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e418e97e-1672-480f-88e4-3e6cd52c891e admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.237161 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e418e97e-1672-480f-88e4-3e6cd52c891e admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/87de4490-d704-4532-be66-da61de0817f8 HTTP/1.1" status: 204 len: 168 time: 0.2377384 Sep 16 16:22:57.243842 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8f8a15da-0ecb-4b58-8f14-4a51e3375a6c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c2ac8dc9b34b46d8a4ec26b5b8de735f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5218942 Sep 16 16:22:57.243842 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8a15da-0ecb-4b58-8f14-4a51e3375a6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43083d17-6a30-4ac9-ac18-d7d885c2670a,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.245170 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36494) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:57.290374 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e418e97e-1672-480f-88e4-3e6cd52c891e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87de4490-d704-4532-be66-da61de0817f8,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.356143 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604a053f-a0ad-44fb-9cd7-94ac388a83a4 req-c81b0d3e-374d-4c33-a35a-141f703e5a07 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:57.358063 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-604a053f-a0ad-44fb-9cd7-94ac388a83a4 req-c81b0d3e-374d-4c33-a35a-141f703e5a07 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0857024 Sep 16 16:22:57.404067 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-604a053f-a0ad-44fb-9cd7-94ac388a83a4 req-13ac0904-05e0-4ab3-ac6c-faa8efe4b9f2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399034 Sep 16 16:22:57.411377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cedc2ad2-fd5f-41dd-853f-2083d915574a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.469267 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cedc2ad2-fd5f-41dd-853f-2083d915574a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.473313 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-932b503d-9abb-473b-a4c2-df7ac2aa17da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.484323 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-932b503d-9abb-473b-a4c2-df7ac2aa17da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.575165 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-932b503d-9abb-473b-a4c2-df7ac2aa17da admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ada63fbde32f4c7d91a1fcf69440bce7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6249719 Sep 16 16:22:57.577862 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36506) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:57.578000 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932b503d-9abb-473b-a4c2-df7ac2aa17da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8fbaea1-1c3a-436d-a182-575e63709d4f,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.594218 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ec91d974-1df8-4ab5-991b-161fcd90cf2d {{(pid=93950) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:22:57.603075 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.618179 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.provisioning_blocks [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Transition to ACTIVE for port object ec91d974-1df8-4ab5-991b-161fcd90cf2d will not be triggered until provisioned by entity L2. {{(pid=93950) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:22:57.619768 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cedc2ad2-fd5f-41dd-853f-2083d915574a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.622424 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cedc2ad2-fd5f-41dd-853f-2083d915574a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.623826 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-cedc2ad2-fd5f-41dd-853f-2083d915574a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/43083d17-6a30-4ac9-ac18-d7d885c2670a HTTP/1.1" status: 204 len: 168 time: 0.3755081 Sep 16 16:22:57.628316 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.641907 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cedc2ad2-fd5f-41dd-853f-2083d915574a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43083d17-6a30-4ac9-ac18-d7d885c2670a,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.647276 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-84cc269f-2656-413a-8df4-9747d912636a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.683498 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-84cc269f-2656-413a-8df4-9747d912636a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.693568 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Pushing event updated for resources: {'Port': ['ID=ec91d974-1df8-4ab5-991b-161fcd90cf2d,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.749242 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-84cc269f-2656-413a-8df4-9747d912636a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.753203 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-84cc269f-2656-413a-8df4-9747d912636a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.754597 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-84cc269f-2656-413a-8df4-9747d912636a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d8fbaea1-1c3a-436d-a182-575e63709d4f HTTP/1.1" status: 204 len: 168 time: 0.1756415 Sep 16 16:22:57.763173 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84cc269f-2656-413a-8df4-9747d912636a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8fbaea1-1c3a-436d-a182-575e63709d4f,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.771920 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36514) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:57.777036 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Attempting to bind port ec91d974-1df8-4ab5-991b-161fcd90cf2d on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:22:57.777595 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Attempting to bind port ec91d974-1df8-4ab5-991b-161fcd90cf2d by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:22:57.778099 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Attempting to bind port ec91d974-1df8-4ab5-991b-161fcd90cf2d on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:57.783745 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Port ec91d974-1df8-4ab5-991b-161fcd90cf2d on network 143ad357-dcc1-47a6-a228-62d36164e62c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:22:57.791398 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-915c72e1-f4e6-4d6b-b8ce-88519b4cd593 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.794406 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Attempting to bind port ec91d974-1df8-4ab5-991b-161fcd90cf2d on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:22:57.800108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 22, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:22:57.800652 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Checking segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:22:57.801203 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Bound using segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:22:57.801807 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Bound port: ec91d974-1df8-4ab5-991b-161fcd90cf2d, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:22:57.802319 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.876468 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] For port ec91d974-1df8-4ab5-991b-161fcd90cf2d, host hv-cinder-80588, cleared binding levels {{(pid=93950) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:22:57.879805 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] For port ec91d974-1df8-4ab5-991b-161fcd90cf2d, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93950) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:22:57.885996 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.907660 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-915c72e1-f4e6-4d6b-b8ce-88519b4cd593 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.917945 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-915c72e1-f4e6-4d6b-b8ce-88519b4cd593 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.975202 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:57.978341 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-915c72e1-f4e6-4d6b-b8ce-88519b4cd593 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f395a10c-9063-4f60-a159-5eab80b5af57,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:57.978745 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:57.988816 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] 10.222.0.66 "PUT /v2.0/ports/ec91d974-1df8-4ab5-991b-161fcd90cf2d HTTP/1.1" status: 200 len: 1093 time: 1.0490701 Sep 16 16:22:57.988965 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-915c72e1-f4e6-4d6b-b8ce-88519b4cd593 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=7be1c31823124d1e8a095c0f297a2d71&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2158365 Sep 16 16:22:57.989602 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'tag': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:22:57.990010 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36522) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:58.003432 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07d616a0-8685-4762-870f-57c8eda04d57" -d '{"events": [{"name": "network-changed", "server_uuid": "61d82ed2-1452-4850-addf-fbe9461ec0ee", "tag": "ec91d974-1df8-4ab5-991b-161fcd90cf2d"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:22:58.090784 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:22:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-166da2f1-f696-4cd8-baad-a323df6681a2 x-openstack-request-id: req-166da2f1-f696-4cd8-baad-a323df6681a2 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:22:58.091088 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "61d82ed2-1452-4850-addf-fbe9461ec0ee", "tag": "ec91d974-1df8-4ab5-991b-161fcd90cf2d", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:22:58.091372 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-166da2f1-f696-4cd8-baad-a323df6681a2 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:22:58.091811 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'tag': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'status': 'completed', 'code': 200} Sep 16 16:22:58.092381 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb747f9-a508-4fd2-b811-7647cdbbbc9d service neutron] Pushing event updated for resources: {'Port': ['ID=ec91d974-1df8-4ab5-991b-161fcd90cf2d,revision_number=3']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:58.127759 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-0fd2e1ad-3d3f-49f2-9ef5-31f20218b456 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:58.129317 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-0fd2e1ad-3d3f-49f2-9ef5-31f20218b456 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 1096 time: 0.0710778 Sep 16 16:22:58.130516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-616be9e3-569f-4395-8cf2-549f2744c11a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.162183 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-616be9e3-569f-4395-8cf2-549f2744c11a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.190628 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-2ee288f4-8011-4174-8740-02471ce9b2f2 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d HTTP/1.1" status: 200 len: 217 time: 0.0494022 Sep 16 16:22:58.228041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-616be9e3-569f-4395-8cf2-549f2744c11a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.230825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-616be9e3-569f-4395-8cf2-549f2744c11a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.234365 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-616be9e3-569f-4395-8cf2-549f2744c11a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f395a10c-9063-4f60-a159-5eab80b5af57 HTTP/1.1" status: 204 len: 168 time: 0.2410841 Sep 16 16:22:58.244955 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616be9e3-569f-4395-8cf2-549f2744c11a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f395a10c-9063-4f60-a159-5eab80b5af57,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:58.306408 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-f5319a1d-a5f8-4e77-9859-dd21e8e48ea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:58.308611 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-f5319a1d-a5f8-4e77-9859-dd21e8e48ea9 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.1013718 Sep 16 16:22:58.321195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36534) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:58.422110 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-85b1abf5-a199-4147-bc25-dcb8fc74480d service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0831311 Sep 16 16:22:58.424025 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7164225-eb74-4b42-a4d3-c8ee7470f853 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.484485 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72827c46-75d0-4862-b1cc-ebd484ec3123 req-99a1aa4a-3353-4c6a-b7a6-264b125964b1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:58.492651 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-72827c46-75d0-4862-b1cc-ebd484ec3123 req-99a1aa4a-3353-4c6a-b7a6-264b125964b1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 943 time: 0.1384218 Sep 16 16:22:58.547147 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e655aafb-54f3-48da-bc75-7c8701adf668 req-4a33a913-ff8b-4226-bed4-c801a2e71da5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:58.550044 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e655aafb-54f3-48da-bc75-7c8701adf668 req-4a33a913-ff8b-4226-bed4-c801a2e71da5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0653913 Sep 16 16:22:58.623055 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e655aafb-54f3-48da-bc75-7c8701adf668 req-7656e8a0-3290-463b-809e-85f2764aaa7d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663617 Sep 16 16:22:58.634306 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-72827c46-75d0-4862-b1cc-ebd484ec3123 req-6d94dd82-4273-44ec-9da0-75d82f7ddc27 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1405196 Sep 16 16:22:58.652967 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-643de0f9-d225-4cae-af36-b7597340c2e0 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2115345 Sep 16 16:22:58.770353 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7164225-eb74-4b42-a4d3-c8ee7470f853 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.776421 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7164225-eb74-4b42-a4d3-c8ee7470f853 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.819184 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-06bbc361-6b69-48b3-a656-c4ff4663d5b9 req-3f011801-4db1-457b-bbfc-bf26c243966d service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1529047 Sep 16 16:22:58.825753 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7164225-eb74-4b42-a4d3-c8ee7470f853 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b36b8dc2-b9e5-400e-8be3-4a22d1a75760,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:58.838604 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a7164225-eb74-4b42-a4d3-c8ee7470f853 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=041ca24de50a4500889344d360e17df2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5073488 Sep 16 16:22:58.839847 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36562) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:22:58.928480 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5d042d35-34d4-4d7e-97aa-639d282643ea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:58.952601 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d616a0-8685-4762-870f-57c8eda04d57 req-c14dc78c-339b-40b4-8efa-fbd09158f8c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:58.955025 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-c14dc78c-339b-40b4-8efa-fbd09158f8c6 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 1096 time: 0.0727816 Sep 16 16:22:58.965572 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5d042d35-34d4-4d7e-97aa-639d282643ea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:59.054996 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:22:59.089309 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5d042d35-34d4-4d7e-97aa-639d282643ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:59.092146 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5d042d35-34d4-4d7e-97aa-639d282643ea admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:22:59.096190 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5d042d35-34d4-4d7e-97aa-639d282643ea admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b36b8dc2-b9e5-400e-8be3-4a22d1a75760 HTTP/1.1" status: 204 len: 168 time: 0.2549314 Sep 16 16:22:59.106044 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d616a0-8685-4762-870f-57c8eda04d57 req-68f21223-8213-40fb-bea2-04589df980ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:59.107553 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-68f21223-8213-40fb-bea2-04589df980ac service neutron] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 916 time: 0.1387110 Sep 16 16:22:59.108764 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d042d35-34d4-4d7e-97aa-639d282643ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b36b8dc2-b9e5-400e-8be3-4a22d1a75760,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:22:59.161464 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-2977669b-31fd-46c4-b3ab-ef7df952b107 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d HTTP/1.1" status: 200 len: 217 time: 0.0436137 Sep 16 16:22:59.234731 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d616a0-8685-4762-870f-57c8eda04d57 req-2911304f-d853-49d5-9f99-6086f95a4f4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:59.236540 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-2911304f-d853-49d5-9f99-6086f95a4f4b service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.0658820 Sep 16 16:22:59.272417 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-a8d45adb-c4e9-4400-8128-41a3c2333948 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257845 Sep 16 16:22:59.401282 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-c9f82236-358f-4089-b53c-01f40132e0a5 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1109161 Sep 16 16:22:59.520297 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-07d616a0-8685-4762-870f-57c8eda04d57 req-458c582f-1d72-4d50-8875-96d9a37c2d44 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1082125 Sep 16 16:22:59.756668 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1490fcac-948c-4554-9d4c-12c1c5f7fbd7 req-ffec8b3e-099c-4caa-9695-ffee54bd8f39 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:59.760358 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1490fcac-948c-4554-9d4c-12c1c5f7fbd7 req-ffec8b3e-099c-4caa-9695-ffee54bd8f39 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0642591 Sep 16 16:22:59.808401 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1490fcac-948c-4554-9d4c-12c1c5f7fbd7 req-508f3cf4-2074-4739-ac87-e1cbdc3451a6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402560 Sep 16 16:22:59.844700 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ff3534-49b7-48b7-989b-1a336794faff req-a54555ce-b32e-41d4-8c93-13cff236af8e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:22:59.846471 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c5ff3534-49b7-48b7-989b-1a336794faff req-a54555ce-b32e-41d4-8c93-13cff236af8e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 943 time: 0.1244464 Sep 16 16:22:59.900078 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c5ff3534-49b7-48b7-989b-1a336794faff req-db2e808e-156d-4c82-844b-978785bef2e4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464087 Sep 16 16:23:00.505284 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b45d88-35f3-4828-ad93-63790f8cd40a req-cde54631-5e3c-478c-acbb-38e6f398ac0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:00.506988 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7b45d88-35f3-4828-ad93-63790f8cd40a req-cde54631-5e3c-478c-acbb-38e6f398ac0e tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0637867 Sep 16 16:23:00.546205 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7b45d88-35f3-4828-ad93-63790f8cd40a req-9099cf9e-5d52-4640-9493-756ccc879d53 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324008 Sep 16 16:23:00.957930 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc5d67b-a5a0-42a9-89f6-0ebd2360eb2f req-3249a5c0-80f3-4162-92bd-d5772c1797c7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:00.966617 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-acc5d67b-a5a0-42a9-89f6-0ebd2360eb2f req-3249a5c0-80f3-4162-92bd-d5772c1797c7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0653698 Sep 16 16:23:01.018885 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-acc5d67b-a5a0-42a9-89f6-0ebd2360eb2f req-110e07ee-ffce-4dea-843e-5f406e9486bd tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508816 Sep 16 16:23:01.131601 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b4962c5-4699-4cee-b456-edb7c4290cfa req-d3be8b82-a237-492a-b788-73716aee5567 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:01.135291 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2b4962c5-4699-4cee-b456-edb7c4290cfa req-d3be8b82-a237-492a-b788-73716aee5567 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 943 time: 0.1101243 Sep 16 16:23:01.192944 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2b4962c5-4699-4cee-b456-edb7c4290cfa req-0f21217b-a9ec-433f-9bf6-2b1b12f0bbaa tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516357 Sep 16 16:23:01.664886 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57396f44-5e56-40ec-81c3-3b0685fc7467 req-c06ac9dc-42ea-4462-84ea-d71e77604e93 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:01.667659 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-57396f44-5e56-40ec-81c3-3b0685fc7467 req-c06ac9dc-42ea-4462-84ea-d71e77604e93 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0505359 Sep 16 16:23:01.703786 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-57396f44-5e56-40ec-81c3-3b0685fc7467 req-5c324401-cf67-4ca6-99d7-1093dbc9d75b tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316603 Sep 16 16:23:02.126908 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df282f22-57a2-45b9-baf6-e16ef7bb83a6 req-dc87be5c-c2f7-4d8c-8224-df1b876142d8 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:02.132586 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-df282f22-57a2-45b9-baf6-e16ef7bb83a6 req-dc87be5c-c2f7-4d8c-8224-df1b876142d8 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0518553 Sep 16 16:23:02.169764 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-df282f22-57a2-45b9-baf6-e16ef7bb83a6 req-20a951a0-5d43-45ef-96a2-5ddaf4255e18 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344238 Sep 16 16:23:02.226559 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec91d974-1df8-4ab5-991b-161fcd90cf2d details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:23:02.357405 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ec91d974-1df8-4ab5-991b-161fcd90cf2d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:02.376168 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'port_id': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'mac_address': 'fa:16:3e:a9:5a:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 703, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '57a636e1-0951-4c2f-8be2-8ca36acb1d05', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:23:02.391592 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a96d89-4068-423d-bdcb-8128d6e4a378 req-49abf9b6-814b-4d13-a67b-bf04c43a7426 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:02.393147 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-55a96d89-4068-423d-bdcb-8128d6e4a378 req-49abf9b6-814b-4d13-a67b-bf04c43a7426 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 943 time: 0.0951393 Sep 16 16:23:02.414906 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:02.435658 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec91d974-1df8-4ab5-991b-161fcd90cf2d {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:02.438343 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-55a96d89-4068-423d-bdcb-8128d6e4a378 req-d10d7166-522d-4315-bfd0-6a27d44a1b0c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384583 Sep 16 16:23:02.457838 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ec91d974-1df8-4ab5-991b-161fcd90cf2d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:02.466117 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:02.514250 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=ec91d974-1df8-4ab5-991b-161fcd90cf2d,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:02.703814 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-f1da4ac4-831f-4251-a30e-fda7b235bde7 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:02.705284 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-f1da4ac4-831f-4251-a30e-fda7b235bde7 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.66 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0528269 Sep 16 16:23:02.842493 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6dc0001-5199-4112-9a43-6a5427a5ae07 req-a437b5ad-3bc6-40b7-8452-015be6084822 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:02.844050 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6dc0001-5199-4112-9a43-6a5427a5ae07 req-a437b5ad-3bc6-40b7-8452-015be6084822 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 946 time: 0.0581760 Sep 16 16:23:02.881802 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['ec91d974-1df8-4ab5-991b-161fcd90cf2d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:02.884780 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Deleting port e23a376e-556e-4737-ada1-f038ddbcf060 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:23:02.885284 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:02.907860 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6dc0001-5199-4112-9a43-6a5427a5ae07 req-82849b2a-a6f4-4856-a9c1-c4ff54248429 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/security-groups?id=9917623a-7304-4264-9dbb-de2cfbbf57fb&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559998 Sep 16 16:23:03.177503 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] For port e23a376e-556e-4737-ada1-f038ddbcf060, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e23a376e-556e-4737-ada1-f038ddbcf060,segment=NetworkSegment(6f8c7cc7-81db-4318-8cb5-16b891d859e6),segment_id=6f8c7cc7-81db-4318-8cb5-16b891d859e6)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:03.178091 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.196392 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Calling delete_port for e23a376e-556e-4737-ada1-f038ddbcf060 owned by compute:nova {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:23:03.363763 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5e183e-13ec-437c-b3c2-8acaaa7555b1 req-7e459ebb-ca2c-4dc1-885d-e6075dc1bcd6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:03.365306 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6a5e183e-13ec-437c-b3c2-8acaaa7555b1 req-7e459ebb-ca2c-4dc1-885d-e6075dc1bcd6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0783682 Sep 16 16:23:03.455948 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6a5e183e-13ec-437c-b3c2-8acaaa7555b1 req-7130484d-ffe7-492c-933c-88413fe15c2b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763724 Sep 16 16:23:03.458207 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.505375 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Pushing event deleted for resources: {'Port': ['ID=e23a376e-556e-4737-ada1-f038ddbcf060,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:03.524667 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36816) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:03.556625 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.557243 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.557595 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.557932 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.558263 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.558595 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.558924 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.559276 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.559610 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.559935 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.560274 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.560580 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.584795 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] No DVR routers for this DVR port e23a376e-556e-4737-ada1-f038ddbcf060 on host hv-cinder-80588 {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:23:03.592325 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.594205 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3c93b037-b769-42de-8a97-57583f3a28f7 req-80c3c093-aeeb-4665-833a-7384393c25e9 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.66 "DELETE /v2.0/ports/e23a376e-556e-4737-ada1-f038ddbcf060 HTTP/1.1" status: 204 len: 173 time: 0.8808455 Sep 16 16:23:03.594663 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68798125-7e39-4c0b-807d-f17667e701f2', 'name': 'network-vif-deleted', 'tag': 'e23a376e-556e-4737-ada1-f038ddbcf060'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:03.597024 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c43c95c-d97c-4c0f-a62f-35a5f55e7343" -d '{"events": [{"server_uuid": "68798125-7e39-4c0b-807d-f17667e701f2", "name": "network-vif-deleted", "tag": "e23a376e-556e-4737-ada1-f038ddbcf060"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:03.605700 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aff4b94-a120-48a6-8e29-d7eff7b7b606 req-f084b9e6-eb5a-43e0-ab5e-b14243ccb4a5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:03.614786 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5aff4b94-a120-48a6-8e29-d7eff7b7b606 req-f084b9e6-eb5a-43e0-ab5e-b14243ccb4a5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 944 time: 0.0797288 Sep 16 16:23:03.637028 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7234b654-0e75-4275-a6c0-3348ea651bde x-openstack-request-id: req-7234b654-0e75-4275-a6c0-3348ea651bde {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:03.637322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "68798125-7e39-4c0b-807d-f17667e701f2", "name": "network-vif-deleted", "tag": "e23a376e-556e-4737-ada1-f038ddbcf060", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:03.637608 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-7234b654-0e75-4275-a6c0-3348ea651bde {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:03.638107 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '68798125-7e39-4c0b-807d-f17667e701f2', 'name': 'network-vif-deleted', 'tag': 'e23a376e-556e-4737-ada1-f038ddbcf060', 'status': 'completed', 'code': 200} Sep 16 16:23:03.668679 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5aff4b94-a120-48a6-8e29-d7eff7b7b606 req-39d392ee-5286-4320-accb-be98c1a05ecc tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518568 Sep 16 16:23:03.669566 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.760701 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.764990 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.805649 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=996831a6cf3d4381af7b91a38029cdd1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2798970 Sep 16 16:23:03.806499 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a30c832-e00f-4aa5-b074-fce30b3caf80,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:03.808380 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36832) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:03.813508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.813857 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.814190 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.814693 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.815022 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.815387 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.815706 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.816208 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.816801 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.817144 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.817617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.818092 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fe6a61a-75dd-4b5b-bac7-622dcefcef09 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:03.860575 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-06b00037-e804-4dc4-b7d2-577e8b4e40fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.886285 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-06b00037-e804-4dc4-b7d2-577e8b4e40fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.935566 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-06b00037-e804-4dc4-b7d2-577e8b4e40fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.938111 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-06b00037-e804-4dc4-b7d2-577e8b4e40fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:03.939275 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-06b00037-e804-4dc4-b7d2-577e8b4e40fd admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9a30c832-e00f-4aa5-b074-fce30b3caf80 HTTP/1.1" status: 204 len: 168 time: 0.1298239 Sep 16 16:23:03.948920 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b00037-e804-4dc4-b7d2-577e8b4e40fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a30c832-e00f-4aa5-b074-fce30b3caf80,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:04.020162 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ae642334-3440-4c10-95d5-0e3f6342413d req-af62ee49-951a-4e96-a6c9-00236dc775a3 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.0307722 Sep 16 16:23:04.224275 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36840) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:04.237516 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fbbe784e-60eb-453b-ad67-4af945fdab87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.323912 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fbbe784e-60eb-453b-ad67-4af945fdab87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.328210 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fbbe784e-60eb-453b-ad67-4af945fdab87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.372816 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-fbbe784e-60eb-453b-ad67-4af945fdab87 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=771bee9a0eb6415da06c94210e7bc640&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1419981 Sep 16 16:23:04.372816 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbe784e-60eb-453b-ad67-4af945fdab87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8295fe73-ec1f-4393-aab8-2c8885a524df,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:04.373027 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36844) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:04.417780 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-78b36676-e651-4a81-9d03-bee274527c86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.438373 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-78b36676-e651-4a81-9d03-bee274527c86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.482651 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-78b36676-e651-4a81-9d03-bee274527c86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.485290 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-78b36676-e651-4a81-9d03-bee274527c86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:04.486518 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-78b36676-e651-4a81-9d03-bee274527c86 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8295fe73-ec1f-4393-aab8-2c8885a524df HTTP/1.1" status: 204 len: 168 time: 0.1151297 Sep 16 16:23:04.494639 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b36676-e651-4a81-9d03-bee274527c86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8295fe73-ec1f-4393-aab8-2c8885a524df,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:04.578114 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06787984-9372-4373-8d53-7525930a43f7 req-695116d1-e4db-42df-bb8c-e4ef998d32ff tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:04.579618 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-06787984-9372-4373-8d53-7525930a43f7 req-695116d1-e4db-42df-bb8c-e4ef998d32ff tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0479400 Sep 16 16:23:04.618166 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-06787984-9372-4373-8d53-7525930a43f7 req-8ac212eb-370b-480f-b679-98a0d2a479c5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326188 Sep 16 16:23:04.785138 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d5fff3-adfc-4e25-94d8-50b472f4b389 req-e01e83a6-4894-4c6e-a0d5-bafd58c43d4d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:04.786601 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-42d5fff3-adfc-4e25-94d8-50b472f4b389 req-e01e83a6-4894-4c6e-a0d5-bafd58c43d4d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 944 time: 0.0527565 Sep 16 16:23:04.825509 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-42d5fff3-adfc-4e25-94d8-50b472f4b389 req-bfc22a5e-e97e-4e22-ac68-4c5135871e69 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324974 Sep 16 16:23:05.113432 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8ffa6a16-7068-44bf-98ec-e6f92200fc4a req-c66f5474-de07-4b17-9ba5-9b978fc89f58 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.0257218 Sep 16 16:23:05.728480 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25935887-1f91-43f7-b282-bfb481c016e1 req-50a73479-7fb5-4452-81ec-5a9c73bef495 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:05.729946 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-25935887-1f91-43f7-b282-bfb481c016e1 req-50a73479-7fb5-4452-81ec-5a9c73bef495 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0470443 Sep 16 16:23:05.767578 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-25935887-1f91-43f7-b282-bfb481c016e1 req-1f0debe0-0788-45a2-a138-5148db36de53 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318308 Sep 16 16:23:05.939136 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e1a469-f7c8-4139-827a-1fd4a44bc202 req-1bd1b1ad-97bf-4a96-ab27-0f4dbbc3eeb8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:05.940600 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-08e1a469-f7c8-4139-827a-1fd4a44bc202 req-1bd1b1ad-97bf-4a96-ab27-0f4dbbc3eeb8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 944 time: 0.0509148 Sep 16 16:23:05.981364 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-08e1a469-f7c8-4139-827a-1fd4a44bc202 req-f9db45c7-02a3-4640-9a60-4339bf468bf8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338886 Sep 16 16:23:06.223926 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa6710f1-effc-4730-a4ff-76367519d238 req-b52884ad-64f4-41df-8b0b-4254419b57b7 tempest-DeleteServersTestJSON-593536250 tempest-DeleteServersTestJSON-593536250-project] 10.222.0.59 "GET /v2.0/ports?device_id=68798125-7e39-4c0b-807d-f17667e701f2 HTTP/1.1" status: 200 len: 210 time: 0.0423980 Sep 16 16:23:06.568726 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['e23a376e-556e-4737-ada1-f038ddbcf060'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:06.910201 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec91d974-1df8-4ab5-991b-161fcd90cf2d up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:23:06.916526 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352d6c5a-c322-4eb2-be53-88b05a487d2a req-2182cbad-11bf-4f40-9956-ebad18d836e7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:06.925553 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-352d6c5a-c322-4eb2-be53-88b05a487d2a req-2182cbad-11bf-4f40-9956-ebad18d836e7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0697074 Sep 16 16:23:06.986237 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-352d6c5a-c322-4eb2-be53-88b05a487d2a req-90cfc7b2-40ab-402e-a927-83be0d6e183f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592437 Sep 16 16:23:07.015497 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36970) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:07.052988 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port ec91d974-1df8-4ab5-991b-161fcd90cf2d completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:23:07.060623 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port ec91d974-1df8-4ab5-991b-161fcd90cf2d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:23:07.061082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.092159 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 36976) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:07.193678 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac2c534-0226-47c8-b9cb-b24123791fe7 req-0491ac81-4747-464f-80e3-a587a1d26b7a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:07.195799 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dac2c534-0226-47c8-b9cb-b24123791fe7 req-0491ac81-4747-464f-80e3-a587a1d26b7a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 944 time: 0.1075478 Sep 16 16:23:07.244134 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.277238 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:07.277926 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dac2c534-0226-47c8-b9cb-b24123791fe7 req-a0a05891-d0c3-4cf6-b331-8fb54a07e4af tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756845 Sep 16 16:23:07.279635 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed6f742d-a6d2-4918-986f-c7af85f2dd3f" -d '{"events": [{"server_uuid": "61d82ed2-1452-4850-addf-fbe9461ec0ee", "name": "network-vif-plugged", "status": "completed", "tag": "ec91d974-1df8-4ab5-991b-161fcd90cf2d"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:07.281605 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3253c790-f791-4f23-ac16-4f32010ce2e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.302180 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ec91d974-1df8-4ab5-991b-161fcd90cf2d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:07.308716 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.317089 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da7b40e3-a8d4-4c08-bbfe-ae162c575ce8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.337539 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-910d1996-0494-496e-876e-de4c3f14dbdc x-openstack-request-id: req-910d1996-0494-496e-876e-de4c3f14dbdc {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:07.338154 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61d82ed2-1452-4850-addf-fbe9461ec0ee", "name": "network-vif-plugged", "status": "completed", "tag": "ec91d974-1df8-4ab5-991b-161fcd90cf2d", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:07.338435 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-910d1996-0494-496e-876e-de4c3f14dbdc {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:07.338872 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'code': 200} Sep 16 16:23:07.368778 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=ec91d974-1df8-4ab5-991b-161fcd90cf2d,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:07.377911 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.378283 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.378627 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.379646 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.380070 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.380504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.380952 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.381381 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.382448 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.382878 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.383339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.383759 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:23:07.424365 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3253c790-f791-4f23-ac16-4f32010ce2e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.429664 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3253c790-f791-4f23-ac16-4f32010ce2e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.478526 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 36994) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:07.479109 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3253c790-f791-4f23-ac16-4f32010ce2e5 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6ca6b00e1e54485cabe8bf1650e056cf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3855805 Sep 16 16:23:07.481469 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3253c790-f791-4f23-ac16-4f32010ce2e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23ca9591-7cb4-4d01-a719-41f586a8ebd8,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:07.556313 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da7b40e3-a8d4-4c08-bbfe-ae162c575ce8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.557672 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da491567-0250-4a8a-80ca-e91a0576b930 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.562275 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da7b40e3-a8d4-4c08-bbfe-ae162c575ce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.596944 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da491567-0250-4a8a-80ca-e91a0576b930 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.628924 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-da7b40e3-a8d4-4c08-bbfe-ae162c575ce8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a9d423c204d74f76a6f537b603043bd3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6122873 Sep 16 16:23:07.631805 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37000) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:07.639446 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da7b40e3-a8d4-4c08-bbfe-ae162c575ce8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6775b26-00cc-4cbc-a8b8-52cd3b502459,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:07.669020 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da491567-0250-4a8a-80ca-e91a0576b930 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.671642 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-da491567-0250-4a8a-80ca-e91a0576b930 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.672874 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-da491567-0250-4a8a-80ca-e91a0576b930 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/23ca9591-7cb4-4d01-a719-41f586a8ebd8 HTTP/1.1" status: 204 len: 168 time: 0.1931965 Sep 16 16:23:07.681235 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da491567-0250-4a8a-80ca-e91a0576b930 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23ca9591-7cb4-4d01-a719-41f586a8ebd8,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:07.695552 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4ff56dc5-fcba-419a-b9de-0952f628a104 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.717809 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4ff56dc5-fcba-419a-b9de-0952f628a104 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.773056 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4ff56dc5-fcba-419a-b9de-0952f628a104 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.776176 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4ff56dc5-fcba-419a-b9de-0952f628a104 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:07.777661 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4ff56dc5-fcba-419a-b9de-0952f628a104 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e6775b26-00cc-4cbc-a8b8-52cd3b502459 HTTP/1.1" status: 204 len: 168 time: 0.1447582 Sep 16 16:23:07.786826 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff56dc5-fcba-419a-b9de-0952f628a104 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6775b26-00cc-4cbc-a8b8-52cd3b502459,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:07.980799 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37014) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:08.006610 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6bd4dc97-f27c-4772-ad1d-7030e83ea4c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.142226 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78a2dbf-32fe-4b13-9197-2c7a77a05463 req-34c22341-3e0b-4486-9b5f-f3831a8902b7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:08.144493 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c78a2dbf-32fe-4b13-9197-2c7a77a05463 req-34c22341-3e0b-4486-9b5f-f3831a8902b7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0611508 Sep 16 16:23:08.156292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6bd4dc97-f27c-4772-ad1d-7030e83ea4c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.169101 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6bd4dc97-f27c-4772-ad1d-7030e83ea4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.190876 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c78a2dbf-32fe-4b13-9197-2c7a77a05463 req-5f248bc1-0ef4-4eac-9b4e-d081ce52226c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392745 Sep 16 16:23:08.216910 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd4dc97-f27c-4772-ad1d-7030e83ea4c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=daebc956-2a8e-4bc4-b244-16c342369681,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:08.223883 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-6bd4dc97-f27c-4772-ad1d-7030e83ea4c1 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=854e4234d6834efcbe4abeb643ae1775&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2368321 Sep 16 16:23:08.227016 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37026) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:08.250579 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37028) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:08.265395 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8e088e74-f8ac-409c-b16a-586d52ab9068 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.281147 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-dc095e20-e38f-44cd-9d6b-0b9358ceb929 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.304142 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-dc095e20-e38f-44cd-9d6b-0b9358ceb929 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.355967 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-dc095e20-e38f-44cd-9d6b-0b9358ceb929 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.358756 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-dc095e20-e38f-44cd-9d6b-0b9358ceb929 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.359994 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-dc095e20-e38f-44cd-9d6b-0b9358ceb929 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/daebc956-2a8e-4bc4-b244-16c342369681 HTTP/1.1" status: 204 len: 168 time: 0.1320238 Sep 16 16:23:08.368487 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc095e20-e38f-44cd-9d6b-0b9358ceb929 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=daebc956-2a8e-4bc4-b244-16c342369681,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:08.391448 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8e088e74-f8ac-409c-b16a-586d52ab9068 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.396650 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8e088e74-f8ac-409c-b16a-586d52ab9068 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.442480 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b886be-b490-408e-830f-cae06c1fb079 req-ccb52fa0-315f-4c29-b4d0-ed66c636310b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:08.443984 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d8b886be-b490-408e-830f-cae06c1fb079 req-ccb52fa0-315f-4c29-b4d0-ed66c636310b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.1026812 Sep 16 16:23:08.451140 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8e088e74-f8ac-409c-b16a-586d52ab9068 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=99b7aa0ec1d846d0829d13899fcc6fb0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1994729 Sep 16 16:23:08.454133 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37034) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:08.469194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e088e74-f8ac-409c-b16a-586d52ab9068 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a549a522-989b-4899-b7c2-000d91c41903,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:08.500819 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d8b886be-b490-408e-830f-cae06c1fb079 req-fbfe0f37-9951-464b-b2f3-2ae921a9e5c1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467491 Sep 16 16:23:08.520566 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-406c5bbf-c8d3-4274-a943-7ad358eac938 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.542711 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-406c5bbf-c8d3-4274-a943-7ad358eac938 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.591874 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-406c5bbf-c8d3-4274-a943-7ad358eac938 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.594404 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-406c5bbf-c8d3-4274-a943-7ad358eac938 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:08.595613 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-406c5bbf-c8d3-4274-a943-7ad358eac938 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a549a522-989b-4899-b7c2-000d91c41903 HTTP/1.1" status: 204 len: 168 time: 0.1403487 Sep 16 16:23:08.603479 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406c5bbf-c8d3-4274-a943-7ad358eac938 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a549a522-989b-4899-b7c2-000d91c41903,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:09.313301 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06fe613-c309-4368-a80f-389c70f5ff20 req-45c46b2d-64f7-4c06-8c13-64838379bb85 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:09.314725 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b06fe613-c309-4368-a80f-389c70f5ff20 req-45c46b2d-64f7-4c06-8c13-64838379bb85 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0487666 Sep 16 16:23:09.361161 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b06fe613-c309-4368-a80f-389c70f5ff20 req-355dc549-13d8-4569-b3cb-1c1cc48fe81a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395908 Sep 16 16:23:09.362094 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e23a376e-556e-4737-ada1-f038ddbcf060 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:23:09.383825 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: e23a376e-556e-4737-ada1-f038ddbcf060 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:23:09.384170 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e23a376e-556e-4737-ada1-f038ddbcf060 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:23:09.625654 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cc1d7f-b323-4499-a4ec-f354e4aa59eb req-74834a2b-5c9a-430f-8370-0a74554f96eb tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:09.627373 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-31cc1d7f-b323-4499-a4ec-f354e4aa59eb req-74834a2b-5c9a-430f-8370-0a74554f96eb tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0592568 Sep 16 16:23:09.675170 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-31cc1d7f-b323-4499-a4ec-f354e4aa59eb req-aaf8b43e-74d4-4e27-b68e-b615ee98789d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396440 Sep 16 16:23:10.458265 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29730a1c-e8f7-4c67-badd-4ed9e9a82697 req-1f40b52c-5423-4810-b43a-c1ab89ee0b26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:10.460410 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-29730a1c-e8f7-4c67-badd-4ed9e9a82697 req-1f40b52c-5423-4810-b43a-c1ab89ee0b26 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 1098 time: 0.0536098 Sep 16 16:23:10.498515 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-29730a1c-e8f7-4c67-badd-4ed9e9a82697 req-3547f3ea-4295-4b90-91e8-e77d3bca9853 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0296445 Sep 16 16:23:10.498691 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95f11ec-69b8-493f-804c-0cb63ba8a242 req-3da9f405-58aa-48dc-a81e-b325d3ef258d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:10.500739 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a95f11ec-69b8-493f-804c-0cb63ba8a242 req-3da9f405-58aa-48dc-a81e-b325d3ef258d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0521481 Sep 16 16:23:10.543821 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a95f11ec-69b8-493f-804c-0cb63ba8a242 req-868061d4-7446-4fd8-8040-f2d84a28c8d4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328355 Sep 16 16:23:10.801285 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb04e69c-4587-476f-8657-89794317c1b1 req-be44b904-b1b4-43eb-b44d-0b8d6abf0131 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:10.802999 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-cb04e69c-4587-476f-8657-89794317c1b1 req-be44b904-b1b4-43eb-b44d-0b8d6abf0131 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0587573 Sep 16 16:23:10.842938 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-cb04e69c-4587-476f-8657-89794317c1b1 req-cab4027f-33ca-45c7-a0e1-f853fcfc574f tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338411 Sep 16 16:23:11.657180 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10f611c-d312-4910-ae3f-6e58c08e6b1d req-4f19c3ec-44c3-4160-b9b2-8ef38289c02f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:11.659435 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e10f611c-d312-4910-ae3f-6e58c08e6b1d req-4f19c3ec-44c3-4160-b9b2-8ef38289c02f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0548024 Sep 16 16:23:11.703589 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e10f611c-d312-4910-ae3f-6e58c08e6b1d req-a3ce1292-2b44-470b-a2a6-51e6399e968c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374370 Sep 16 16:23:11.933961 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37208) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:11.992704 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a8d1e2-cec3-4a78-a07d-790e19247c57 req-a72271af-81ba-4177-addd-68bbdd94826e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:11.996505 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-25a8d1e2-cec3-4a78-a07d-790e19247c57 req-a72271af-81ba-4177-addd-68bbdd94826e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0672092 Sep 16 16:23:11.998979 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Deleting subnet e4933948-8e0f-4ede-a776-0bbd1e3c2a6c {{(pid=93951) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:23:12.002506 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.049024 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-25a8d1e2-cec3-4a78-a07d-790e19247c57 req-c6c3144f-8b5d-4df7-a771-0b10f3a31d7a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478287 Sep 16 16:23:12.053709 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.070419 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.135616 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for subnet, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.162635 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e4933948-8e0f-4ede-a776-0bbd1e3c2a6c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:12.166690 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.168537 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5e4fdcef-438c-46cd-b5d2-84d7dffc1fb4 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/e4933948-8e0f-4ede-a776-0bbd1e3c2a6c HTTP/1.1" status: 204 len: 168 time: 0.2328577 Sep 16 16:23:12.170938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37224) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:12.241518 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.322643 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.343010 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > segment before_delete 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.343376 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.344132 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.344534 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > port after_create 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.344945 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > port after_delete 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.345307 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > port after_update 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.345629 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > segment after_delete 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.346006 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.346329 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.346699 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet after_update 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.483479 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.483825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.484150 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet before_create 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.484541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Subscribe: > subnet before_update 55550000 {{(pid=93951) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 16 16:23:12.484903 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4c32c31-4aa7-4c54-bdb8-3e5674bb6304']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:23:12.502195 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f8c7cc7-81db-4318-8cb5-16b891d859e6') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:23:12.502444 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f8c7cc7-81db-4318-8cb5-16b891d859e6') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:23:12.522275 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.541828 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.550165 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Releasing vlan 731 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:23:12.550548 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: from cryptography.utils import int_from_bytes Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: from cryptography.utils import int_from_bytes Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:23:12.554910 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:23:12.616789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.625143 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.627487 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] 10.222.0.59 "DELETE /v2.0/networks/b4c32c31-4aa7-4c54-bdb8-3e5674bb6304 HTTP/1.1" status: 204 len: 168 time: 0.4554226 Sep 16 16:23:12.639181 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64706ae0-1809-412e-ab4f-0a3901779ded admin admin] Pushing event deleted for resources: {'Network': ['ID=b4c32c31-4aa7-4c54-bdb8-3e5674bb6304,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:12.830628 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4783e690-5a62-4a9d-82a5-183d18b8ba18 req-bb5f10ea-9e82-4b72-95a3-624531cd3a56 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:12.832753 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4783e690-5a62-4a9d-82a5-183d18b8ba18 req-bb5f10ea-9e82-4b72-95a3-624531cd3a56 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0540345 Sep 16 16:23:12.836503 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37250) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:12.874283 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4783e690-5a62-4a9d-82a5-183d18b8ba18 req-2be81821-556b-40eb-b0bc-0aaa7b906890 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343759 Sep 16 16:23:12.878339 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3bad658e-d4d2-46a2-8059-8107fcd13233 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=8142a9d3002f4b6d8aa31c635da07520&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0405438 Sep 16 16:23:12.880875 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37254) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:12.929285 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37256) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:12.932772 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5d9d3530-2db3-48e9-9d20-42435abcaadd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.953473 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5d9d3530-2db3-48e9-9d20-42435abcaadd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:12.998435 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5d9d3530-2db3-48e9-9d20-42435abcaadd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.001002 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5d9d3530-2db3-48e9-9d20-42435abcaadd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.002143 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5d9d3530-2db3-48e9-9d20-42435abcaadd admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9917623a-7304-4264-9dbb-de2cfbbf57fb HTTP/1.1" status: 204 len: 168 time: 0.1203778 Sep 16 16:23:13.011234 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d9d3530-2db3-48e9-9d20-42435abcaadd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9917623a-7304-4264-9dbb-de2cfbbf57fb,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:13.034422 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-67443876-77bc-4a6a-b197-e6d01488ada4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.135822 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-67443876-77bc-4a6a-b197-e6d01488ada4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.140442 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-67443876-77bc-4a6a-b197-e6d01488ada4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.185861 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-67443876-77bc-4a6a-b197-e6d01488ada4 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=326ca2c02e3848058c9c3b23ed0fc75b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2554832 Sep 16 16:23:13.187035 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67443876-77bc-4a6a-b197-e6d01488ada4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72c419ba-e381-40ad-9853-2e21f37bf604,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:13.189516 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37270) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:13.192065 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f05e1f9-02ce-4283-873a-e7a433120364 req-b07b818f-4efc-4380-8397-30abce93728a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:13.193665 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f05e1f9-02ce-4283-873a-e7a433120364 req-b07b818f-4efc-4380-8397-30abce93728a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0677247 Sep 16 16:23:13.266663 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f5a480d-6cc1-4ad6-9e0f-f5b29d270eb6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.276009 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f05e1f9-02ce-4283-873a-e7a433120364 req-3515ab81-bc06-43dc-85d4-b661b0de1f05 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607867 Sep 16 16:23:13.303016 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f5a480d-6cc1-4ad6-9e0f-f5b29d270eb6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.363091 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f5a480d-6cc1-4ad6-9e0f-f5b29d270eb6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.365757 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f5a480d-6cc1-4ad6-9e0f-f5b29d270eb6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.366981 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3f5a480d-6cc1-4ad6-9e0f-f5b29d270eb6 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/72c419ba-e381-40ad-9853-2e21f37bf604 HTTP/1.1" status: 204 len: 168 time: 0.1766472 Sep 16 16:23:13.376468 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5a480d-6cc1-4ad6-9e0f-f5b29d270eb6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72c419ba-e381-40ad-9853-2e21f37bf604,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:13.652625 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37304) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:13.703872 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37310) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:13.823008 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37318) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:13.840919 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cda369e-e0f7-44c6-89cf-874d8c66c529 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:13.924041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0135da9f-3ae3-40a3-b6ed-f37ac7b74516 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.007540 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cda369e-e0f7-44c6-89cf-874d8c66c529 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.028430 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1cda369e-e0f7-44c6-89cf-874d8c66c529 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.042545 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-be251dd5-b6a4-4435-95ce-bac469163407 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.107476 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8efd71c-0141-4388-9bb3-942fb054f5ae req-a8eefed7-53e1-48cf-8b0c-72f793b4cffd tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:14.108939 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c8efd71c-0141-4388-9bb3-942fb054f5ae req-a8eefed7-53e1-48cf-8b0c-72f793b4cffd tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.1372714 Sep 16 16:23:14.117636 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1cda369e-e0f7-44c6-89cf-874d8c66c529 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=3f8036efbcf64d36a16f3bf2376638d5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2916086 Sep 16 16:23:14.120625 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37332) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:14.123019 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cda369e-e0f7-44c6-89cf-874d8c66c529 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f7ede49-397a-4a2a-970a-501a22498e97,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.177007 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-91e7ed65-c3c5-43e0-b943-cec786d1ab7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.178099 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c8efd71c-0141-4388-9bb3-942fb054f5ae req-b86e6c1a-9ffd-4b81-be77-2ddd5e0a16e9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575993 Sep 16 16:23:14.214500 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-91e7ed65-c3c5-43e0-b943-cec786d1ab7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.234405 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0135da9f-3ae3-40a3-b6ed-f37ac7b74516 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.241979 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0135da9f-3ae3-40a3-b6ed-f37ac7b74516 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.280035 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-91e7ed65-c3c5-43e0-b943-cec786d1ab7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.282624 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-91e7ed65-c3c5-43e0-b943-cec786d1ab7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.283997 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-91e7ed65-c3c5-43e0-b943-cec786d1ab7f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/3f7ede49-397a-4a2a-970a-501a22498e97 HTTP/1.1" status: 204 len: 168 time: 0.1623306 Sep 16 16:23:14.292946 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e7ed65-c3c5-43e0-b943-cec786d1ab7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f7ede49-397a-4a2a-970a-501a22498e97,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.297447 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0135da9f-3ae3-40a3-b6ed-f37ac7b74516 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67ead86f-16c0-4ba7-a4bf-c7450c8ac63a,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.302474 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0135da9f-3ae3-40a3-b6ed-f37ac7b74516 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a9b4021387094184b561b05df560938e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6484544 Sep 16 16:23:14.307318 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37338) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:14.392771 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-d1ffe1d3-fb88-4ff7-b348-1d13e97eaa88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.428287 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-be251dd5-b6a4-4435-95ce-bac469163407 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.431012 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-d1ffe1d3-fb88-4ff7-b348-1d13e97eaa88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.438595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-be251dd5-b6a4-4435-95ce-bac469163407 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.499360 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-be251dd5-b6a4-4435-95ce-bac469163407 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=fe8d0e75aae94b6ba73cfd79f31b23ce&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7915714 Sep 16 16:23:14.499360 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be251dd5-b6a4-4435-95ce-bac469163407 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33644130-d52c-4b07-8c4a-d8fc33a92d4b,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.500817 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37344) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:14.543667 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-d1ffe1d3-fb88-4ff7-b348-1d13e97eaa88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.546462 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-d1ffe1d3-fb88-4ff7-b348-1d13e97eaa88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.549958 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-d1ffe1d3-fb88-4ff7-b348-1d13e97eaa88 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/67ead86f-16c0-4ba7-a4bf-c7450c8ac63a HTTP/1.1" status: 204 len: 168 time: 0.2393796 Sep 16 16:23:14.562106 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1ffe1d3-fb88-4ff7-b348-1d13e97eaa88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67ead86f-16c0-4ba7-a4bf-c7450c8ac63a,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.569160 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0592bdc3-ecd8-4098-946d-91e2127f3e8c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.592646 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0592bdc3-ecd8-4098-946d-91e2127f3e8c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.652125 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0592bdc3-ecd8-4098-946d-91e2127f3e8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.655388 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0592bdc3-ecd8-4098-946d-91e2127f3e8c admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.656076 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0592bdc3-ecd8-4098-946d-91e2127f3e8c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/33644130-d52c-4b07-8c4a-d8fc33a92d4b HTTP/1.1" status: 204 len: 168 time: 0.1543281 Sep 16 16:23:14.664737 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0592bdc3-ecd8-4098-946d-91e2127f3e8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33644130-d52c-4b07-8c4a-d8fc33a92d4b,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.715474 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37354) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:14.736197 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4f3cce09-1ee4-49c1-9dfb-c1f9c250714c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.853475 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4f3cce09-1ee4-49c1-9dfb-c1f9c250714c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.861742 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4f3cce09-1ee4-49c1-9dfb-c1f9c250714c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.902989 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4f3cce09-1ee4-49c1-9dfb-c1f9c250714c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=718164962d804e94b2ffcbff148d2d77&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1864314 Sep 16 16:23:14.904076 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3cce09-1ee4-49c1-9dfb-c1f9c250714c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9177a39-66df-4c18-b79c-bbf38d9d0e9f,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:14.905728 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37364) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:14.957173 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2a160c07-aaf9-492c-af90-f70ca5eedd64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:14.984405 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2a160c07-aaf9-492c-af90-f70ca5eedd64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.037339 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2a160c07-aaf9-492c-af90-f70ca5eedd64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.043001 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2a160c07-aaf9-492c-af90-f70ca5eedd64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.046993 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2a160c07-aaf9-492c-af90-f70ca5eedd64 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f9177a39-66df-4c18-b79c-bbf38d9d0e9f HTTP/1.1" status: 204 len: 168 time: 0.1379764 Sep 16 16:23:15.058493 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a160c07-aaf9-492c-af90-f70ca5eedd64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9177a39-66df-4c18-b79c-bbf38d9d0e9f,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:15.102878 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.154560 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37378) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:15.167718 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4023c1e0-b559-4679-9c40-424f2b8dcebd admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.278731 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4023c1e0-b559-4679-9c40-424f2b8dcebd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.287043 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4023c1e0-b559-4679-9c40-424f2b8dcebd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.322693 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e23a82be-fbe3-4a8b-8ee2-c70fe9cdfece req-cb28fb94-5511-4c12-bb1a-7ec1ec95cdb2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:15.330852 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4023c1e0-b559-4679-9c40-424f2b8dcebd admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c17d63a4ea7c4061bc72c5e6c405f82d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1751263 Sep 16 16:23:15.332355 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4023c1e0-b559-4679-9c40-424f2b8dcebd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=910455ad-a7ba-4053-b15c-2b601e99abc8,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:15.333524 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e23a82be-fbe3-4a8b-8ee2-c70fe9cdfece req-cb28fb94-5511-4c12-bb1a-7ec1ec95cdb2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0615208 Sep 16 16:23:15.335754 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37388) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:15.369799 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e23a82be-fbe3-4a8b-8ee2-c70fe9cdfece req-89ee17a5-d696-414e-91d9-c9d85297491e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354297 Sep 16 16:23:15.401653 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d51c704e-e8aa-4ff8-99a3-795d010ff5b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.425005 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d51c704e-e8aa-4ff8-99a3-795d010ff5b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.483431 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d51c704e-e8aa-4ff8-99a3-795d010ff5b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.485910 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d51c704e-e8aa-4ff8-99a3-795d010ff5b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:15.487073 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-d51c704e-e8aa-4ff8-99a3-795d010ff5b5 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/910455ad-a7ba-4053-b15c-2b601e99abc8 HTTP/1.1" status: 204 len: 168 time: 0.1501348 Sep 16 16:23:15.499446 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51c704e-e8aa-4ff8-99a3-795d010ff5b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=910455ad-a7ba-4053-b15c-2b601e99abc8,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:15.859401 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37416) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:15.878015 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2d929e75-ecbb-48b4-aadd-3a1c9b81272f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.031261 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2d929e75-ecbb-48b4-aadd-3a1c9b81272f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.041423 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2d929e75-ecbb-48b4-aadd-3a1c9b81272f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.060481 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-211221de-8045-438d-89a7-ce2b019d930a service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0753930 Sep 16 16:23:16.105744 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-2d929e75-ecbb-48b4-aadd-3a1c9b81272f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0998d0a939ce4962881f6ded3cccead8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2451906 Sep 16 16:23:16.107119 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d929e75-ecbb-48b4-aadd-3a1c9b81272f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=415532e9-7ec3-4aa5-a7b7-81ebebb4fc3d,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:16.108386 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 37428) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:16.177278 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c617b2db-7587-4783-bde5-9a3fff7a5815 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.201956 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-462d2fa3-408e-437d-8dc2-ddab54066c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:16.204106 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-462d2fa3-408e-437d-8dc2-ddab54066c8d service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 1098 time: 0.0801165 Sep 16 16:23:16.213750 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c617b2db-7587-4783-bde5-9a3fff7a5815 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.379933 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-a3525178-56c7-4439-8f75-e2eace774c2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:16.381730 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-a3525178-56c7-4439-8f75-e2eace774c2c service neutron] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 916 time: 0.1497540 Sep 16 16:23:16.480921 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-4591f46f-c085-46bd-8b42-8a22a6c02851 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3 HTTP/1.1" status: 200 len: 217 time: 0.0775449 Sep 16 16:23:16.625527 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-2e0b2ac3-c3be-443c-866a-a7a9bcc62fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:16.627146 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-2e0b2ac3-c3be-443c-866a-a7a9bcc62fe8 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.1337750 Sep 16 16:23:16.630592 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3ad1dd-c576-4e3f-b5c7-d17fc2a46e4c req-f897034b-1cf4-4f20-9099-a76f2bdaf58f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:16.639566 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6e3ad1dd-c576-4e3f-b5c7-d17fc2a46e4c req-f897034b-1cf4-4f20-9099-a76f2bdaf58f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0902500 Sep 16 16:23:16.661968 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c617b2db-7587-4783-bde5-9a3fff7a5815 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.665416 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c617b2db-7587-4783-bde5-9a3fff7a5815 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:16.669623 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c617b2db-7587-4783-bde5-9a3fff7a5815 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/415532e9-7ec3-4aa5-a7b7-81ebebb4fc3d HTTP/1.1" status: 204 len: 168 time: 0.5595629 Sep 16 16:23:16.671103 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-5a0c478c-494a-4203-8e8c-2be95bc68778 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0312102 Sep 16 16:23:16.726825 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6e3ad1dd-c576-4e3f-b5c7-d17fc2a46e4c req-cc58258d-ed73-488c-9c2d-c42304e8282b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864697 Sep 16 16:23:16.730094 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c617b2db-7587-4783-bde5-9a3fff7a5815 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=415532e9-7ec3-4aa5-a7b7-81ebebb4fc3d,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:16.838309 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-8ab82571-161e-49cc-9d20-90c82c26f503 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1569917 Sep 16 16:23:16.945313 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d31fb8e-7416-4966-b511-89920a67ad82 req-20eb8e4d-dae8-4e14-b890-0660d5292931 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0975113 Sep 16 16:23:17.874547 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd3621b-f8bc-4a8d-be5f-12c6f3306fec req-4729019b-6e73-4273-91e3-d7b8206553d9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:17.883935 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8cd3621b-f8bc-4a8d-be5f-12c6f3306fec req-4729019b-6e73-4273-91e3-d7b8206553d9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0703578 Sep 16 16:23:17.938178 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8cd3621b-f8bc-4a8d-be5f-12c6f3306fec req-4b5e7c00-e601-4283-82aa-b529cfb26753 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457432 Sep 16 16:23:18.010709 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c4bff6-a96c-4442-b5ff-e147b3ddfb9f req-a461b998-d401-45f4-a5f3-3fa09c2b683f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:18.015336 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-66c4bff6-a96c-4442-b5ff-e147b3ddfb9f req-a461b998-d401-45f4-a5f3-3fa09c2b683f service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 1099 time: 0.0584579 Sep 16 16:23:18.048486 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37530) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:18.059518 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-66c4bff6-a96c-4442-b5ff-e147b3ddfb9f req-b1a0e5ea-f8e7-48cb-87d2-97e44074618f service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357702 Sep 16 16:23:18.113085 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-fbcbfd31-516e-4271-b595-8752cbf20637 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:18.114449 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-fbcbfd31-516e-4271-b595-8752cbf20637 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.1502633 Sep 16 16:23:18.129262 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-1bc6498b-fec6-4c58-a015-2baf065f557d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/quotas/0378b53234de487d8ebc6eeb3fbfbe5d HTTP/1.1" status: 200 len: 375 time: 0.0091090 Sep 16 16:23:18.156163 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5c4f242e-a3e0-42b2-aacb-ba68f2dc1039 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.179928 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-dc437f7d-5b76-46c9-8492-eb19cbada758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0449359 Sep 16 16:23:18.255811 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5c4f242e-a3e0-42b2-aacb-ba68f2dc1039 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.260094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5c4f242e-a3e0-42b2-aacb-ba68f2dc1039 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.294767 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-e81aa14c-aee2-4401-820e-ce125ca4a476 service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1060731 Sep 16 16:23:18.303582 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5c4f242e-a3e0-42b2-aacb-ba68f2dc1039 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=668cda6580a04bdda0df312c5d53abc5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2540143 Sep 16 16:23:18.304213 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 37540) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:18.312083 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4f242e-a3e0-42b2-aacb-ba68f2dc1039 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1b40a41-2ca3-4dc9-8aad-104e83d33699,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:18.360563 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e90e7dc6-3d99-481e-a1cb-3f8ccfefbf12 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.394443 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e90e7dc6-3d99-481e-a1cb-3f8ccfefbf12 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.430129 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-d47d7725-ec88-4a69-bf71-f7b7c286701e service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1289470 Sep 16 16:23:18.471391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e90e7dc6-3d99-481e-a1cb-3f8ccfefbf12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.475529 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e90e7dc6-3d99-481e-a1cb-3f8ccfefbf12 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:18.482089 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e90e7dc6-3d99-481e-a1cb-3f8ccfefbf12 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b1b40a41-2ca3-4dc9-8aad-104e83d33699 HTTP/1.1" status: 204 len: 168 time: 0.1759388 Sep 16 16:23:18.491872 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90e7dc6-3d99-481e-a1cb-3f8ccfefbf12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1b40a41-2ca3-4dc9-8aad-104e83d33699,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:18.712688 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a57b16a5-341e-4b71-be94-8249cc0df629 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/networks?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0680554 Sep 16 16:23:18.995086 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-3fe536ff-3296-4157-9abc-08989543a6e5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:18.995086 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-3fe536ff-3296-4157-9abc-08989543a6e5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2753472 Sep 16 16:23:19.011756 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-883c5132-8c49-42cd-a60b-21df49e34e9b tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/quotas/96c75cd13f92458bae1e2ed82f3a73bb HTTP/1.1" status: 200 len: 375 time: 0.0099137 Sep 16 16:23:19.048126 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-5f81bb09-3e65-476e-bb38-c8deb10ca729 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0299361 Sep 16 16:23:19.218579 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f4f41998-9eaf-4a12-b305-f99712f2177d req-880d91a8-7bfa-4a5f-af18-eec2e34fce4b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 210 time: 0.0273314 Sep 16 16:23:19.342796 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14d002a-430b-4569-8d3b-89cd6c3c32e6 req-d9084276-65cb-43eb-b240-9492b1f9c1c2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:19.344656 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d14d002a-430b-4569-8d3b-89cd6c3c32e6 req-d9084276-65cb-43eb-b240-9492b1f9c1c2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0537143 Sep 16 16:23:19.387937 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d14d002a-430b-4569-8d3b-89cd6c3c32e6 req-692e1219-d10b-48cf-bdd1-d1a1cad610a6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357683 Sep 16 16:23:19.459192 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a4c7d91e-9cd8-402f-a139-f0e2a70bf420 req-9988e523-ee11-4315-8243-dc6d91ad11fc tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0318451 Sep 16 16:23:20.309482 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-81decfed-a97a-466c-8ea4-3756048a2439 req-f8365dfe-db7f-45a6-9347-6ad050559b77 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 210 time: 0.0245514 Sep 16 16:23:20.496681 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dba9e39-e060-4782-b40e-6396dbc0a2d0 req-4fb64a97-8e28-4909-8f05-23d020c0984b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:20.498026 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5dba9e39-e060-4782-b40e-6396dbc0a2d0 req-4fb64a97-8e28-4909-8f05-23d020c0984b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0457790 Sep 16 16:23:20.535514 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5dba9e39-e060-4782-b40e-6396dbc0a2d0 req-2aada2cf-ac6a-4f4d-afbb-c22050441237 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316691 Sep 16 16:23:20.611435 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb3d9207-19cf-4a6f-b417-512f382fd229 req-f62902df-e72e-4dc2-8bd8-cb448449186d tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0242054 Sep 16 16:23:20.713431 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ba90c1d7-aa26-4920-b6ca-e8998fad0e27 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:21.410101 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6247a8ac-2785-44f6-89f2-98777c187d30 req-8f5dee87-21b1-4a6a-bad0-22487ee41beb tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 210 time: 0.0285976 Sep 16 16:23:21.652711 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf2a788-906c-4673-8086-23610dee2566 req-c0a2e0be-73e6-4aae-a975-bc71113d79da tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:21.654384 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1cf2a788-906c-4673-8086-23610dee2566 req-c0a2e0be-73e6-4aae-a975-bc71113d79da tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0497668 Sep 16 16:23:21.692696 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1cf2a788-906c-4673-8086-23610dee2566 req-a2ca3e04-99ca-4e06-bbab-bae814bf624a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323653 Sep 16 16:23:21.703336 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6e56b4a-97f3-48cf-a331-6fc6f15771c1 req-c789be3c-3d45-42f6-b92f-2f35a8f45936 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0263391 Sep 16 16:23:22.503728 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c8f426f4-7599-4bd0-8304-d589c50d3a95 req-63e3ee83-2187-431d-add3-ac9e3d4f260b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 210 time: 0.0248215 Sep 16 16:23:22.811121 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78043d4c-9449-42f2-acc5-21bbb4afe262 req-8d8d3e1d-286b-4f52-a4a8-e53185fe12b5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:22.812603 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-78043d4c-9449-42f2-acc5-21bbb4afe262 req-8d8d3e1d-286b-4f52-a4a8-e53185fe12b5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0471256 Sep 16 16:23:22.852124 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-78043d4c-9449-42f2-acc5-21bbb4afe262 req-2a9a2cc2-cdda-4d43-8b6c-85ffbdf4123f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334377 Sep 16 16:23:22.944313 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-29de8272-27c0-4924-996f-cf7271dd15a5 req-7f47c172-e7da-4c1e-a9f5-80872bbbbe23 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0320244 Sep 16 16:23:23.436383 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-7bb0befe-2f99-44ef-9055-1247fc2fe632 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:23.593343 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00a7e48f-8622-4c65-88c6-23e7b11624aa req-bd0d1de3-b123-4294-8dff-9116ec1d3eb5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 210 time: 0.0257995 Sep 16 16:23:23.711539 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:23.964037 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d46ed2-0ac1-4506-aa75-bd81b35ff326 req-0cbb1939-3828-43a3-bfd5-0937a51c2ddc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:23.965461 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e9d46ed2-0ac1-4506-aa75-bd81b35ff326 req-0cbb1939-3828-43a3-bfd5-0937a51c2ddc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0477765 Sep 16 16:23:24.001824 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e9d46ed2-0ac1-4506-aa75-bd81b35ff326 req-97fd0480-f956-41bd-8d48-d1f30dafe2ee tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302801 Sep 16 16:23:24.079367 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b1e14af5-3455-4f08-972e-708b5e2a1cbb req-c5d9d901-b21d-4df7-84fe-082dbf4b760b tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0264292 Sep 16 16:23:24.347160 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:24.684223 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-951616ea-b3c7-473d-9832-9bdb530465ff req-c2ac1cd8-f8ba-4ee4-a36e-cd0a247f0299 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 210 time: 0.0273948 Sep 16 16:23:24.948214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-da73100a-8cee-4a02-974a-7480165e92f9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:24.949738 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-da73100a-8cee-4a02-974a-7480165e92f9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.1019969 Sep 16 16:23:24.973106 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Request body: {'port': {'device_id': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'admin_state_up': True, 'tenant_id': '0378b53234de487d8ebc6eeb3fbfbe5d'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:25.088808 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Made reservation on behalf of 0378b53234de487d8ebc6eeb3fbfbe5d for: {'port': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:25.092896 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.139536 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef055550-1ec7-400f-905d-05369e54c86d req-4f839b49-080b-4a5f-83f5-c258784182b7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:25.141452 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ef055550-1ec7-400f-905d-05369e54c86d req-4f839b49-080b-4a5f-83f5-c258784182b7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0714064 Sep 16 16:23:25.179793 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ef055550-1ec7-400f-905d-05369e54c86d req-86602ba5-f7af-4142-b609-8ebc456255a5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316751 Sep 16 16:23:25.202118 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b3eaa93f-8bad-4907-b4e6-923327fa4ec7 req-f4847219-df36-40fe-aa15-9017f7bdb7a8 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0337691 Sep 16 16:23:25.265016 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Allocated IP 172.20.0.5 (143ad357-dcc1-47a6-a228-62d36164e62c/57a636e1-0951-4c2f-8be2-8ca36acb1d05/e62f01f3-63a1-4192-9c47-7358f178184b) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:23:25.421574 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-342e1f51-e980-4001-bff9-431e4bb7b41e tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.66 "GET /v2.0/networks?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0221686 Sep 16 16:23:25.445451 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.485368 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.501065 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'ec91d974-1df8-4ab5-991b-161fcd90cf2d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:25.532108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Network 143ad357-dcc1-47a6-a228-62d36164e62c is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:23:25.538630 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:25.541478 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:23:25.577473 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event updated for resources: {'Port': ['ID=e62f01f3-63a1-4192-9c47-7358f178184b,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:25.612313 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:25.612861 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.638213 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5cc60e30-9f80-44e1-9bea-0f5973e73507 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6691954 Sep 16 16:23:25.654661 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-60e85d48-6e54-4fff-8f02-633a35de2063 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:25.656173 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-60e85d48-6e54-4fff-8f02-633a35de2063 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2192600 Sep 16 16:23:25.688204 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Request body: {'port': {'device_id': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:25.690831 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Request body: {'port': {'device_id': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746', 'admin_state_up': True, 'tenant_id': '96c75cd13f92458bae1e2ed82f3a73bb'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:25.799780 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.862656 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2661003-5e83-4927-a785-eed5c4da3ff6 req-72237490-9ae9-4344-87de-cd4141956e7e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:25.864221 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d2661003-5e83-4927-a785-eed5c4da3ff6 req-72237490-9ae9-4344-87de-cd4141956e7e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 931 time: 0.0704243 Sep 16 16:23:25.890689 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Made reservation on behalf of 96c75cd13f92458bae1e2ed82f3a73bb for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:25.894025 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.905489 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:25.926848 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d2661003-5e83-4927-a785-eed5c4da3ff6 req-0139030b-9823-4969-a56c-9724b8de5242 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553396 Sep 16 16:23:26.014779 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.019770 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.087789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c203e23d-8ac4-4859-8784-da907f90655b,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:26.092388 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e62f01f3-63a1-4192-9c47-7358f178184b {{(pid=93950) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:26.106958 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.120092 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.provisioning_blocks [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Transition to ACTIVE for port object e62f01f3-63a1-4192-9c47-7358f178184b will not be triggered until provisioned by entity L2. {{(pid=93950) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:23:26.123818 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.182067 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.194766 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Allocated IP 192.168.233.105 (2484feaf-90a7-4e98-9b4b-a202ddaf5746/c2a91c97-52f1-46d7-9554-fa2169194eda/2e8be2b9-b510-43fb-8639-92b3f61018ba) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:23:26.204223 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Pushing event updated for resources: {'Port': ['ID=e62f01f3-63a1-4192-9c47-7358f178184b,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:26.331575 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Attempting to bind port e62f01f3-63a1-4192-9c47-7358f178184b on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:23:26.331957 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Attempting to bind port e62f01f3-63a1-4192-9c47-7358f178184b by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:23:26.332285 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Attempting to bind port e62f01f3-63a1-4192-9c47-7358f178184b on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:26.340685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Port e62f01f3-63a1-4192-9c47-7358f178184b on network 143ad357-dcc1-47a6-a228-62d36164e62c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:23:26.341033 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Attempting to bind port e62f01f3-63a1-4192-9c47-7358f178184b on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:26.349476 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 23, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:23:26.349900 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Checking segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:26.350327 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Bound using segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:23:26.350720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Bound port: e62f01f3-63a1-4192-9c47-7358f178184b, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:23:26.351105 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.365087 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8ac095c0-690c-4008-88d0-be7b15454e7e req-379a205c-e498-4127-a5ec-5f2ef3ffdb47 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 210 time: 0.0674739 Sep 16 16:23:26.372934 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8668222c-9b1d-45fe-b3a9-cf8f7e4fb396 req-5eb9a25e-6b9a-4645-9db1-97270c3c13cf tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:26.374462 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8668222c-9b1d-45fe-b3a9-cf8f7e4fb396 req-5eb9a25e-6b9a-4645-9db1-97270c3c13cf tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0747249 Sep 16 16:23:26.432455 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.458962 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8668222c-9b1d-45fe-b3a9-cf8f7e4fb396 req-3c9b9466-f9c6-4d54-b9a3-752c5b3bcdb2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579429 Sep 16 16:23:26.460552 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] For port e62f01f3-63a1-4192-9c47-7358f178184b, host hv-cinder-80588, cleared binding levels {{(pid=93950) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:23:26.463800 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] For port e62f01f3-63a1-4192-9c47-7358f178184b, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e62f01f3-63a1-4192-9c47-7358f178184b,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93950) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:23:26.469517 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.484798 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.515767 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:26.516390 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.517777 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] 10.222.0.66 "PUT /v2.0/ports/e62f01f3-63a1-4192-9c47-7358f178184b HTTP/1.1" status: 200 len: 1093 time: 0.8345501 Sep 16 16:23:26.518223 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'tag': 'e62f01f3-63a1-4192-9c47-7358f178184b'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:26.520489 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd21df33-437a-447a-a873-d1e33b9d765b" -d '{"events": [{"name": "network-changed", "server_uuid": "b4de9ca9-e65c-4e85-9cff-dd6c718b10e3", "tag": "e62f01f3-63a1-4192-9c47-7358f178184b"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:26.534720 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:23:26.538767 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:26.541380 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:23:26.558582 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef3a6ed-719b-46b0-a48d-455717cc586f service neutron] Pushing event updated for resources: {'Port': ['ID=e62f01f3-63a1-4192-9c47-7358f178184b,revision_number=3']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:26.573494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a51c25b-13fa-4e51-93dd-27f237918044 x-openstack-request-id: req-4a51c25b-13fa-4e51-93dd-27f237918044 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:26.573789 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b4de9ca9-e65c-4e85-9cff-dd6c718b10e3", "tag": "e62f01f3-63a1-4192-9c47-7358f178184b", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:26.574046 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-4a51c25b-13fa-4e51-93dd-27f237918044 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:26.574469 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'tag': 'e62f01f3-63a1-4192-9c47-7358f178184b', 'status': 'completed', 'code': 200} Sep 16 16:23:26.582067 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Pushing event updated for resources: {'Port': ['ID=2e8be2b9-b510-43fb-8639-92b3f61018ba,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:26.642142 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-dce3385a-df9a-4b55-abc6-63b7719b157e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:26.643994 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-dce3385a-df9a-4b55-abc6-63b7719b157e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 1096 time: 0.0635731 Sep 16 16:23:26.645599 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:26.646232 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.668004 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca36357-afdb-4344-9741-332b30d0815e req-eb069ca8-9ba3-483e-88da-fb84f1374a9d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:26.669592 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8ca36357-afdb-4344-9741-332b30d0815e req-eb069ca8-9ba3-483e-88da-fb84f1374a9d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1209979 Sep 16 16:23:26.675380 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-a8f25f8f-77f8-4d9c-b32e-7a7ec60554bd tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.9904702 Sep 16 16:23:26.703756 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Request body: {'port': {'device_id': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:26.719876 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-daa4f925-b0e8-4306-9b71-9bbfdc0c5ebc service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e62f01f3-63a1-4192-9c47-7358f178184b HTTP/1.1" status: 200 len: 217 time: 0.0579896 Sep 16 16:23:26.742753 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8ca36357-afdb-4344-9741-332b30d0815e req-6eb8d58f-d38c-49d7-8c4f-4946ca132385 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649421 Sep 16 16:23:26.774133 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.787239 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-30f1de24-44c2-4869-b3f9-13aed82cf70c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:26.790031 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-30f1de24-44c2-4869-b3f9-13aed82cf70c service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.0608592 Sep 16 16:23:26.805251 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-fda967a9-bfdd-4aab-b342-95f4fc9a36d8 None None] Provisioning complete for port 2e8be2b9-b510-43fb-8639-92b3f61018ba triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:23:26.805756 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-fda967a9-bfdd-4aab-b342-95f4fc9a36d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:26.847390 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-fda967a9-bfdd-4aab-b342-95f4fc9a36d8 None None] Port 2e8be2b9-b510-43fb-8639-92b3f61018ba cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:23:27.092058 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eefee4d-bd02-44f4-8c8a-6e788c61a5a0 req-b7b161da-769c-4235-b5f9-f02d24e964c1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:27.093947 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5eefee4d-bd02-44f4-8c8a-6e788c61a5a0 req-b7b161da-769c-4235-b5f9-f02d24e964c1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0817709 Sep 16 16:23:27.151130 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2e8be2b9-b510-43fb-8639-92b3f61018ba {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:27.160568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:27.183622 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Transition to ACTIVE for port object 2e8be2b9-b510-43fb-8639-92b3f61018ba will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:23:27.189399 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5eefee4d-bd02-44f4-8c8a-6e788c61a5a0 req-67ab2ce4-a0d5-409b-b484-c633c4ddacf4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734470 Sep 16 16:23:27.190449 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:27.311410 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Pushing event updated for resources: {'Port': ['ID=2e8be2b9-b510-43fb-8639-92b3f61018ba,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:27.348208 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Attempting to bind port 2e8be2b9-b510-43fb-8639-92b3f61018ba on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:23:27.348542 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Attempting to bind port 2e8be2b9-b510-43fb-8639-92b3f61018ba by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:23:27.348869 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Attempting to bind port 2e8be2b9-b510-43fb-8639-92b3f61018ba on network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:27.354703 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Port 2e8be2b9-b510-43fb-8639-92b3f61018ba on network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:23:27.355358 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Attempting to bind port 2e8be2b9-b510-43fb-8639-92b3f61018ba on network 2484feaf-90a7-4e98-9b4b-a202ddaf5746 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:27.362071 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 23, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:23:27.362669 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Checking segment: {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:27.363530 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Bound using segment: {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:23:27.364595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Bound port: 2e8be2b9-b510-43fb-8639-92b3f61018ba, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0841e726-8f7e-455b-8c2a-e02eb1bccc87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 719, 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:23:27.365308 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:27.456189 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] For port 2e8be2b9-b510-43fb-8639-92b3f61018ba, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:23:27.461206 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] For port 2e8be2b9-b510-43fb-8639-92b3f61018ba, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2e8be2b9-b510-43fb-8639-92b3f61018ba,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:23:27.475706 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:27.549654 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:27.550278 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:27.551708 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] 10.222.0.66 "PUT /v2.0/ports/2e8be2b9-b510-43fb-8639-92b3f61018ba HTTP/1.1" status: 200 len: 1098 time: 0.8535721 Sep 16 16:23:27.553537 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'tag': '2e8be2b9-b510-43fb-8639-92b3f61018ba'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:27.555868 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d898a26b-e5ea-4274-921e-f71c819a3022" -d '{"events": [{"name": "network-changed", "server_uuid": "c110f9bd-0c58-447a-86db-65c9090abc8b", "tag": "2e8be2b9-b510-43fb-8639-92b3f61018ba"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:27.573959 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0bfb8ba-533f-45a8-a87f-8019243fbb4d req-fa290671-7887-40b8-ae6e-9b294a7a7520 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:27.575455 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d0bfb8ba-533f-45a8-a87f-8019243fbb4d req-fa290671-7887-40b8-ae6e-9b294a7a7520 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.1020789 Sep 16 16:23:27.606607 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a399f8-4d96-4f75-a9d6-697047f12924 service neutron] Pushing event updated for resources: {'Port': ['ID=2e8be2b9-b510-43fb-8639-92b3f61018ba,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:27.630031 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d0bfb8ba-533f-45a8-a87f-8019243fbb4d req-bb7c938c-0b35-4460-80a6-a8ccebcb4325 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431695 Sep 16 16:23:27.675997 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23b341e7-1152-4f1e-950d-1e6570dfe5bb x-openstack-request-id: req-23b341e7-1152-4f1e-950d-1e6570dfe5bb {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:27.676353 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c110f9bd-0c58-447a-86db-65c9090abc8b", "tag": "2e8be2b9-b510-43fb-8639-92b3f61018ba", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:27.676555 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-23b341e7-1152-4f1e-950d-1e6570dfe5bb {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:27.676947 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'tag': '2e8be2b9-b510-43fb-8639-92b3f61018ba', 'status': 'completed', 'code': 200} Sep 16 16:23:28.318092 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74d6653-c42b-4481-8778-64f47546d390 req-de554b55-f61a-4602-9ceb-2cba4ffdb1e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:28.319619 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f74d6653-c42b-4481-8778-64f47546d390 req-de554b55-f61a-4602-9ceb-2cba4ffdb1e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0483825 Sep 16 16:23:28.357283 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f74d6653-c42b-4481-8778-64f47546d390 req-73f74242-f839-41c7-be19-a1b1ae04bdef tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318365 Sep 16 16:23:28.746861 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681eba9e-354a-436e-80f2-9388469ac92a req-f6aaa9f8-9e48-4876-a9ab-0a0b5f5edbdf tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:28.748325 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-681eba9e-354a-436e-80f2-9388469ac92a req-f6aaa9f8-9e48-4876-a9ab-0a0b5f5edbdf tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.0511551 Sep 16 16:23:28.785920 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-681eba9e-354a-436e-80f2-9388469ac92a req-32c66988-8767-411e-a6ce-86e42f6a6de5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315785 Sep 16 16:23:29.473240 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c65c5dc-b11c-4dcf-8844-5d640510e244 req-291d2e38-44d1-4f0b-938f-ed16ae928ff9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:29.475171 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4c65c5dc-b11c-4dcf-8844-5d640510e244 req-291d2e38-44d1-4f0b-938f-ed16ae928ff9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0495644 Sep 16 16:23:29.510796 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4c65c5dc-b11c-4dcf-8844-5d640510e244 req-bc3af943-06e2-4cf1-a94d-9bea3734b14f tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0298111 Sep 16 16:23:29.762240 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-671b914e-9d50-470c-af84-3ee9b8256135 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251389 Sep 16 16:23:29.809271 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d898a26b-e5ea-4274-921e-f71c819a3022 req-7d18f3f1-3b11-4c66-8bce-46d2ae6091ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:29.814192 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d898a26b-e5ea-4274-921e-f71c819a3022 req-7d18f3f1-3b11-4c66-8bce-46d2ae6091ae service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 1101 time: 0.0401709 Sep 16 16:23:29.848439 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d898a26b-e5ea-4274-921e-f71c819a3022 req-ab45a546-aad5-42ae-a9f0-4a4e79008eeb service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0271513 Sep 16 16:23:30.040945 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-7d7cea05-b714-4115-9b12-dd794e4e6f1b service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2605662 Sep 16 16:23:30.140340 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0092de7f-c061-46db-95e0-c0a197c2a5f8 req-d1ef19ff-b6e2-463f-b467-fd5a112adc42 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853314 Sep 16 16:23:30.237976 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa39b72-ddd7-4f24-b917-eabcb157cd4f req-119617c3-c145-4c98-9268-91e31d3ba0ac tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.239453 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4fa39b72-ddd7-4f24-b917-eabcb157cd4f req-119617c3-c145-4c98-9268-91e31d3ba0ac tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.3814561 Sep 16 16:23:30.255491 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd21df33-437a-447a-a873-d1e33b9d765b req-57ee3ca2-1000-462e-8922-c609099a8e27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.257559 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-57ee3ca2-1000-462e-8922-c609099a8e27 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 1096 time: 0.0532360 Sep 16 16:23:30.291684 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d898a26b-e5ea-4274-921e-f71c819a3022 req-1448bc24-402f-4271-9897-eebce6dfc6ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.293076 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d898a26b-e5ea-4274-921e-f71c819a3022 req-1448bc24-402f-4271-9897-eebce6dfc6ea service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4232543 Sep 16 16:23:30.301010 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4fa39b72-ddd7-4f24-b917-eabcb157cd4f req-0103b7e5-97fa-4fc2-9577-3b6bf9eae00f tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547667 Sep 16 16:23:30.358900 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd21df33-437a-447a-a873-d1e33b9d765b req-898666fa-4c8a-4842-b8d3-ef8145a57565 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.360410 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-898666fa-4c8a-4842-b8d3-ef8145a57565 service neutron] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 916 time: 0.0944722 Sep 16 16:23:30.379610 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-4ca8e703-63d2-4e0a-9cbf-024826ba46db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.381565 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-4ca8e703-63d2-4e0a-9cbf-024826ba46db service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 1101 time: 0.0379760 Sep 16 16:23:30.404164 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-200bf0d8-3951-4b95-964f-d8557ff07340 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e62f01f3-63a1-4192-9c47-7358f178184b HTTP/1.1" status: 200 len: 217 time: 0.0337088 Sep 16 16:23:30.425298 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-8b0e0c03-292a-4814-a48b-f80a546690c6 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=2e8be2b9-b510-43fb-8639-92b3f61018ba HTTP/1.1" status: 200 len: 217 time: 0.0324495 Sep 16 16:23:30.460167 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd21df33-437a-447a-a873-d1e33b9d765b req-96c461d1-fb46-402b-b3e5-358ce25cf776 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.461587 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-96c461d1-fb46-402b-b3e5-358ce25cf776 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.0479994 Sep 16 16:23:30.488356 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-06074dc2-3183-47ce-81ad-2cb9eb3a3150 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.489743 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-06074dc2-3183-47ce-81ad-2cb9eb3a3150 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c2a91c97-52f1-46d7-9554-fa2169194eda HTTP/1.1" status: 200 len: 843 time: 0.0456390 Sep 16 16:23:30.622868 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de0ae31-8a1a-494b-9257-f2ae901126be req-0e25a88e-c23b-4dad-8af7-ede7c39bf1be tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:30.624403 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6de0ae31-8a1a-494b-9257-f2ae901126be req-0e25a88e-c23b-4dad-8af7-ede7c39bf1be tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0475798 Sep 16 16:23:30.662257 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6de0ae31-8a1a-494b-9257-f2ae901126be req-49cb93af-d027-48f5-9666-9eb7f38df629 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316958 Sep 16 16:23:31.414431 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b4aec8-f6e1-42d5-a5a1-3e45b4b3d38d req-d96226e2-0e73-4b0d-bdaa-caf6ceda6b48 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:31.415904 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-35b4aec8-f6e1-42d5-a5a1-3e45b4b3d38d req-d96226e2-0e73-4b0d-bdaa-caf6ceda6b48 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.0465875 Sep 16 16:23:31.451066 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-35b4aec8-f6e1-42d5-a5a1-3e45b4b3d38d req-39c27287-735f-4bfe-8fe9-315c5b9d0eb7 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0295160 Sep 16 16:23:31.777670 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8ce406-2967-4a96-bca8-7f3183fd221b req-34be95c9-b0fc-48dd-968f-7718d0a744c4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:31.779088 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5b8ce406-2967-4a96-bca8-7f3183fd221b req-34be95c9-b0fc-48dd-968f-7718d0a744c4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0496087 Sep 16 16:23:31.813882 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5b8ce406-2967-4a96-bca8-7f3183fd221b req-d1db2e93-37dc-4759-b6f3-064ca34eaea2 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0290735 Sep 16 16:23:32.363814 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-4886d76d-2b8b-4bd0-8cbc-54525ea3ec57 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238824 Sep 16 16:23:32.564553 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7225254e-2a65-450a-9ec7-9dd62faee1de req-e080bfba-7e5a-4930-bc1f-1715750c2447 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:32.565927 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7225254e-2a65-450a-9ec7-9dd62faee1de req-e080bfba-7e5a-4930-bc1f-1715750c2447 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.0505898 Sep 16 16:23:32.602433 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7225254e-2a65-450a-9ec7-9dd62faee1de req-d57afb96-b7d9-4c64-a80c-1bfeaa4d9027 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304923 Sep 16 16:23:32.927367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf97244-155e-403b-9d2b-815d6ceeadb3 req-ff54fbcb-a043-4037-b53f-183aab1d486d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:32.928819 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fdf97244-155e-403b-9d2b-815d6ceeadb3 req-ff54fbcb-a043-4037-b53f-183aab1d486d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0503159 Sep 16 16:23:32.967845 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fdf97244-155e-403b-9d2b-815d6ceeadb3 req-b3a5f0ef-8240-4cfe-b970-a77fbd82f63d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333569 Sep 16 16:23:33.445219 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-857ede77-7777-4df9-9fda-067b3de5308c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:33.446777 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-857ede77-7777-4df9-9fda-067b3de5308c service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=2484feaf-90a7-4e98-9b4b-a202ddaf5746&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.0433600 Sep 16 16:23:33.504370 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-984c93e4-5beb-4baa-bc7f-f6596a372fe0 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0997715 Sep 16 16:23:33.539647 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-3d69711f-bf5c-48ae-9ba7-2dc7bd990436 service neutron] 10.222.0.66 "GET /v2.0/networks/2484feaf-90a7-4e98-9b4b-a202ddaf5746?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814612 Sep 16 16:23:33.600432 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bd21df33-437a-447a-a873-d1e33b9d765b req-122937fb-ee05-4d8d-959d-abf7bda7b0c7 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868552 Sep 16 16:23:33.633865 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9f89c840-3a1f-40e5-b2c5-7da9580d118f req-92cf879e-a96f-45d4-8cec-669c7bddee03 service neutron] 10.222.0.66 "GET /v2.0/networks/2484feaf-90a7-4e98-9b4b-a202ddaf5746?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858529 Sep 16 16:23:33.718322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5868b461-0048-4545-9ae3-c5f1f8a7c9d6 req-bb74de15-b51e-4cd4-bf40-c1ccb4e2bc39 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:33.719847 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5868b461-0048-4545-9ae3-c5f1f8a7c9d6 req-bb74de15-b51e-4cd4-bf40-c1ccb4e2bc39 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.0508802 Sep 16 16:23:33.757965 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5868b461-0048-4545-9ae3-c5f1f8a7c9d6 req-60cfcff1-990a-40f3-97bc-118dceea8aa7 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320563 Sep 16 16:23:34.087983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb4ccbac-c57c-46ad-8e95-f2ad52a0ec58 req-40ffad87-932f-4336-95ae-00851c6cb44e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:34.089859 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cb4ccbac-c57c-46ad-8e95-f2ad52a0ec58 req-40ffad87-932f-4336-95ae-00851c6cb44e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0542486 Sep 16 16:23:34.132378 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cb4ccbac-c57c-46ad-8e95-f2ad52a0ec58 req-f57014a4-84c7-4106-ad9b-e8abd44c1b2e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336235 Sep 16 16:23:34.736566 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-113a6438-71e8-4d3f-81b0-6860e9f746e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:34.738051 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-113a6438-71e8-4d3f-81b0-6860e9f746e2 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0417948 Sep 16 16:23:34.739662 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e529d73-a5b4-4732-8f9f-d39ef1421c6e req-4c714c7d-3c59-49ce-a33b-f7d2b5370798 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:34.741184 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4e529d73-a5b4-4732-8f9f-d39ef1421c6e req-4c714c7d-3c59-49ce-a33b-f7d2b5370798 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0499933 Sep 16 16:23:34.780879 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4e529d73-a5b4-4732-8f9f-d39ef1421c6e req-93196066-f88f-4b42-bf0f-9d3aa711234e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332680 Sep 16 16:23:34.878310 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-1674740c-5b7f-467a-aa96-a1a24fad53f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:34.879811 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-1674740c-5b7f-467a-aa96-a1a24fad53f9 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.1181271 Sep 16 16:23:34.894507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446530f4-23ec-400a-8fa9-b116159a6236 req-49993ade-aa0a-431b-8124-4e74dc1320f2 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:34.895943 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-446530f4-23ec-400a-8fa9-b116159a6236 req-49993ade-aa0a-431b-8124-4e74dc1320f2 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.0625579 Sep 16 16:23:34.943455 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-846961f3-4dbf-4ae5-85bb-67f8ea5e291f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 217 time: 0.0465903 Sep 16 16:23:34.999439 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-446530f4-23ec-400a-8fa9-b116159a6236 req-e4001250-56d6-4959-8eef-0500b3c177a8 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919452 Sep 16 16:23:35.008507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-89cfccf9-4f3c-4bfb-b711-dd5053163ac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:35.009916 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-89cfccf9-4f3c-4bfb-b711-dd5053163ac6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0578029 Sep 16 16:23:35.047783 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-3ad87568-cb56-44ed-ad9f-c0d9eb839111 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233469 Sep 16 16:23:35.157321 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-b8cbebbe-6c07-4b7a-af3d-2579fab32b3c service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918994 Sep 16 16:23:35.275667 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ae82a9-9311-4e72-b95d-590cafcac258 req-3bbf44e7-dcf9-4cfe-8ba5-ba8911e6fbd7 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:35.277457 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d3ae82a9-9311-4e72-b95d-590cafcac258 req-3bbf44e7-dcf9-4cfe-8ba5-ba8911e6fbd7 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 943 time: 0.0648236 Sep 16 16:23:35.286196 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbdfa1c6-bd27-46bd-9c62-815b5d73ef94 req-f2a8945c-5c90-4a6f-aed6-528744e58244 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1098604 Sep 16 16:23:35.329577 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d3ae82a9-9311-4e72-b95d-590cafcac258 req-f58a9404-6471-4cbe-9c6f-45dd9762f82b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418620 Sep 16 16:23:35.596110 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38050) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:35.679923 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38056) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:35.755293 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e62f01f3-63a1-4192-9c47-7358f178184b details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:23:35.756045 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-af3d28f8-a410-4ec1-9439-58f25cbe9187 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:35.783849 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8b926584-bedd-4e29-ad7f-9d833f6cb4c3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:35.874869 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e62f01f3-63a1-4192-9c47-7358f178184b, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e62f01f3-63a1-4192-9c47-7358f178184b,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:35.881463 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-af3d28f8-a410-4ec1-9439-58f25cbe9187 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:35.886027 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'e62f01f3-63a1-4192-9c47-7358f178184b', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'port_id': 'e62f01f3-63a1-4192-9c47-7358f178184b', 'mac_address': 'fa:16:3e:66:2c:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 703, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '57a636e1-0951-4c2f-8be2-8ca36acb1d05', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:23:35.890913 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-af3d28f8-a410-4ec1-9439-58f25cbe9187 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:35.905320 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26173aa2-21f8-4930-8c2b-2129da5ee9fb req-fe1efea2-b9e6-4de3-a8b8-a804f5c5821b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:35.907499 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-26173aa2-21f8-4930-8c2b-2129da5ee9fb req-fe1efea2-b9e6-4de3-a8b8-a804f5c5821b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0525873 Sep 16 16:23:35.924505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:35.937863 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e62f01f3-63a1-4192-9c47-7358f178184b {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:35.948765 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-af3d28f8-a410-4ec1-9439-58f25cbe9187 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=eae93572164044109125660da83cce4f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3490257 Sep 16 16:23:35.949053 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38062) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:35.949674 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3d28f8-a410-4ec1-9439-58f25cbe9187 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f35b845-047f-4e20-8065-9f7d8eed0999,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:35.957801 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e62f01f3-63a1-4192-9c47-7358f178184b, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e62f01f3-63a1-4192-9c47-7358f178184b,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:35.964490 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:35.965202 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2e8be2b9-b510-43fb-8639-92b3f61018ba details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:23:35.968169 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-26173aa2-21f8-4930-8c2b-2129da5ee9fb req-f3f7e88f-d4e0-45fe-b71e-a3a39f5d5112 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536306 Sep 16 16:23:36.014115 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8b926584-bedd-4e29-ad7f-9d833f6cb4c3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.019622 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8b926584-bedd-4e29-ad7f-9d833f6cb4c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.029472 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-bd2c9ed6-2a80-425a-8e43-ee48af430fd2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.050157 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=e62f01f3-63a1-4192-9c47-7358f178184b,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.055621 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:23:36.067013 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8b926584-bedd-4e29-ad7f-9d833f6cb4c3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=91d3172441514193b0d462a9b4da2698&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3856268 Sep 16 16:23:36.067611 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b926584-bedd-4e29-ad7f-9d833f6cb4c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a72da82-7854-4a2c-b13a-c7a37709c51f,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.068571 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-bd2c9ed6-2a80-425a-8e43-ee48af430fd2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.083525 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38066) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:36.116464 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2e8be2b9-b510-43fb-8639-92b3f61018ba, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2e8be2b9-b510-43fb-8639-92b3f61018ba,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:36.126131 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-bd2c9ed6-2a80-425a-8e43-ee48af430fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.129503 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': '2e8be2b9-b510-43fb-8639-92b3f61018ba', 'network_id': '2484feaf-90a7-4e98-9b4b-a202ddaf5746', 'port_id': '2e8be2b9-b510-43fb-8639-92b3f61018ba', 'mac_address': 'fa:16:3e:09:0d:9d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 719, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c2a91c97-52f1-46d7-9554-fa2169194eda', 'ip_address': '192.168.233.105'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:23:36.130060 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-bd2c9ed6-2a80-425a-8e43-ee48af430fd2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.131851 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-bd2c9ed6-2a80-425a-8e43-ee48af430fd2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1f35b845-047f-4e20-8065-9f7d8eed0999 HTTP/1.1" status: 204 len: 168 time: 0.1805484 Sep 16 16:23:36.140322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd2c9ed6-2a80-425a-8e43-ee48af430fd2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f35b845-047f-4e20-8065-9f7d8eed0999,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.172976 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1edfb873-ea76-4506-9377-a512d4799970 req-b1d446e9-8089-4fb6-bb02-c3d87e74fae8 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:36.180000 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1edfb873-ea76-4506-9377-a512d4799970 req-b1d446e9-8089-4fb6-bb02-c3d87e74fae8 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 948 time: 0.0830219 Sep 16 16:23:36.187757 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.214812 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2e8be2b9-b510-43fb-8639-92b3f61018ba {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:36.218546 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5962c474-69c3-40dd-a3a1-3e422b4554e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.233388 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1edfb873-ea76-4506-9377-a512d4799970 req-3bb1973b-a312-45bf-8126-b40058b0dd24 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524166 Sep 16 16:23:36.245406 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2e8be2b9-b510-43fb-8639-92b3f61018ba, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2e8be2b9-b510-43fb-8639-92b3f61018ba,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:36.246598 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5962c474-69c3-40dd-a3a1-3e422b4554e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.257580 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.296635 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5962c474-69c3-40dd-a3a1-3e422b4554e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.299129 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5962c474-69c3-40dd-a3a1-3e422b4554e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.300317 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5962c474-69c3-40dd-a3a1-3e422b4554e2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9a72da82-7854-4a2c-b13a-c7a37709c51f HTTP/1.1" status: 204 len: 168 time: 0.2158306 Sep 16 16:23:36.314508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5962c474-69c3-40dd-a3a1-3e422b4554e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a72da82-7854-4a2c-b13a-c7a37709c51f,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.316701 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=2e8be2b9-b510-43fb-8639-92b3f61018ba,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.448925 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38082) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:36.464052 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd7a57b-0f35-45c2-9503-a35bf1fbf1df req-b13ffbe8-c729-42fa-a739-f36736dda96b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:36.465538 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7cd7a57b-0f35-45c2-9503-a35bf1fbf1df req-b13ffbe8-c729-42fa-a739-f36736dda96b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 944 time: 0.0627248 Sep 16 16:23:36.475398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7fa3a5de-916c-4041-9fa7-2482807d3e69 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.527333 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7cd7a57b-0f35-45c2-9503-a35bf1fbf1df req-3edbe85b-a470-4439-a30c-b0b0214a8219 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527909 Sep 16 16:23:36.593729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7fa3a5de-916c-4041-9fa7-2482807d3e69 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.598893 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7fa3a5de-916c-4041-9fa7-2482807d3e69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.617537 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['e62f01f3-63a1-4192-9c47-7358f178184b'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:36.621816 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2e8be2b9-b510-43fb-8639-92b3f61018ba'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:36.647354 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7fa3a5de-916c-4041-9fa7-2482807d3e69 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=5121e51a900c4d22a9d795e7688f0817&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1974926 Sep 16 16:23:36.648472 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa3a5de-916c-4041-9fa7-2482807d3e69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6887aa76-60b0-4330-961d-ba8fb322d933,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.651011 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38090) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:36.747499 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1ff2d637-ce65-48e2-9279-392236a959ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.785000 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1ff2d637-ce65-48e2-9279-392236a959ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.844859 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1ff2d637-ce65-48e2-9279-392236a959ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.847697 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1ff2d637-ce65-48e2-9279-392236a959ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:36.851958 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1ff2d637-ce65-48e2-9279-392236a959ad admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/6887aa76-60b0-4330-961d-ba8fb322d933 HTTP/1.1" status: 204 len: 168 time: 0.1968348 Sep 16 16:23:36.866508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff2d637-ce65-48e2-9279-392236a959ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6887aa76-60b0-4330-961d-ba8fb322d933,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:36.981570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38108) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:37.099158 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f52090-d37d-416f-b317-79454ca96206 req-83bf47a1-e87a-4361-b054-2a1fa6b0dcf2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:37.103628 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-45f52090-d37d-416f-b317-79454ca96206 req-83bf47a1-e87a-4361-b054-2a1fa6b0dcf2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0568550 Sep 16 16:23:37.153725 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ca1229ec-7971-4b35-b92e-0ad83518dacb admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.159980 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-45f52090-d37d-416f-b317-79454ca96206 req-51917232-89a0-47ee-9de7-a7102229e1f1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502274 Sep 16 16:23:37.265507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ca1229ec-7971-4b35-b92e-0ad83518dacb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.270906 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ca1229ec-7971-4b35-b92e-0ad83518dacb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.319474 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-ca1229ec-7971-4b35-b92e-0ad83518dacb admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f89f529ed3804ce79d7cb2323b6eae85&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3362417 Sep 16 16:23:37.321210 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca1229ec-7971-4b35-b92e-0ad83518dacb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9147d9e-fb35-4df8-9069-6fe066fd90d7,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:37.322147 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38130) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:37.372432 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc90e6d8-0bfc-4f83-b7c2-64da4b90a7df req-9116efa0-4376-43bf-9dad-4b97a009de1b tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:37.374294 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fc90e6d8-0bfc-4f83-b7c2-64da4b90a7df req-9116efa0-4376-43bf-9dad-4b97a009de1b tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 949 time: 0.0584795 Sep 16 16:23:37.394130 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-333a2451-82b4-4320-8fa6-cf2dfdd233d5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.420129 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-333a2451-82b4-4320-8fa6-cf2dfdd233d5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.422864 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fc90e6d8-0bfc-4f83-b7c2-64da4b90a7df req-a6d0772e-e3d4-4049-800f-c1b48a689b75 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417523 Sep 16 16:23:37.473195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-333a2451-82b4-4320-8fa6-cf2dfdd233d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.476364 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-333a2451-82b4-4320-8fa6-cf2dfdd233d5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:37.480051 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-333a2451-82b4-4320-8fa6-cf2dfdd233d5 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c9147d9e-fb35-4df8-9069-6fe066fd90d7 HTTP/1.1" status: 204 len: 168 time: 0.1557992 Sep 16 16:23:37.488381 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333a2451-82b4-4320-8fa6-cf2dfdd233d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9147d9e-fb35-4df8-9069-6fe066fd90d7,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:37.646064 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-110fdcc6-79df-402e-80ea-4f670fe7c80d req-440ae0f1-4bce-407a-ae7a-b4ecca7bae84 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:37.653098 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-110fdcc6-79df-402e-80ea-4f670fe7c80d req-440ae0f1-4bce-407a-ae7a-b4ecca7bae84 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 944 time: 0.0565608 Sep 16 16:23:37.689423 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-110fdcc6-79df-402e-80ea-4f670fe7c80d req-909b22c3-38c7-4369-a032-04d6502d9743 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353699 Sep 16 16:23:37.857106 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38166) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:37.996946 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f653-70c6-4013-a249-195989492a2e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.101724 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f653-70c6-4013-a249-195989492a2e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.107332 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f653-70c6-4013-a249-195989492a2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.147873 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7ed0f653-70c6-4013-a249-195989492a2e admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=fda1d413e6264868921e86cc599a4cb4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2895775 Sep 16 16:23:38.148807 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed0f653-70c6-4013-a249-195989492a2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=677bca2c-de3e-49e2-b480-e3584a6c9864,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:38.150469 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38180) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:38.221487 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e027dac8-b0e7-4470-8167-1e518549cff0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.255419 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e027dac8-b0e7-4470-8167-1e518549cff0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.304146 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6704d5a1-d7e3-477f-bd35-72e0af923501 req-0c8ee806-d097-4661-a8de-ff1327d3b794 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:38.305827 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6704d5a1-d7e3-477f-bd35-72e0af923501 req-0c8ee806-d097-4661-a8de-ff1327d3b794 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0578368 Sep 16 16:23:38.318463 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e027dac8-b0e7-4470-8167-1e518549cff0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.320087 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e027dac8-b0e7-4470-8167-1e518549cff0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.320643 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e027dac8-b0e7-4470-8167-1e518549cff0 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/677bca2c-de3e-49e2-b480-e3584a6c9864 HTTP/1.1" status: 204 len: 168 time: 0.1691856 Sep 16 16:23:38.330154 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e027dac8-b0e7-4470-8167-1e518549cff0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=677bca2c-de3e-49e2-b480-e3584a6c9864,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:38.370208 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6704d5a1-d7e3-477f-bd35-72e0af923501 req-33aa4e1d-7b8e-4728-9d5b-ae7380d79c70 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567417 Sep 16 16:23:38.559465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18ca315-5bd5-44a8-8481-0318f82cb46b req-a3be38f2-e41e-442f-b5ef-1be091a4f24e tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:38.561023 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a18ca315-5bd5-44a8-8481-0318f82cb46b req-a3be38f2-e41e-442f-b5ef-1be091a4f24e tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 949 time: 0.0600941 Sep 16 16:23:38.602284 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a18ca315-5bd5-44a8-8481-0318f82cb46b req-57516ff5-7de9-4c82-80be-1fb3b0ccbc51 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342438 Sep 16 16:23:38.800089 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38212) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:38.814406 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-570f0225-ec73-4b53-b0fe-a443b25e95ea admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.820937 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c8517f-d0e9-4ed7-b764-a2207f084553 req-2c004df3-e337-4f24-a712-9a54b9bfbf62 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:38.828039 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-93c8517f-d0e9-4ed7-b764-a2207f084553 req-2c004df3-e337-4f24-a712-9a54b9bfbf62 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 944 time: 0.0639322 Sep 16 16:23:38.882509 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-93c8517f-d0e9-4ed7-b764-a2207f084553 req-8fc34be2-5c4b-4fcb-b5b2-6be11fb11592 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496583 Sep 16 16:23:38.929781 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-570f0225-ec73-4b53-b0fe-a443b25e95ea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.935973 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-570f0225-ec73-4b53-b0fe-a443b25e95ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:38.988344 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-570f0225-ec73-4b53-b0fe-a443b25e95ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bb7c22a-77c1-41bb-b3d7-1586390e6999,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:38.993934 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-570f0225-ec73-4b53-b0fe-a443b25e95ea admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=4d5e9755558c4cd1b03737996f48a83e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1924789 Sep 16 16:23:38.996715 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38224) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:39.055248 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b19f6c8d-99db-48a9-b0bd-f57e7000adac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.062766 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38226) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:39.079090 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b19f6c8d-99db-48a9-b0bd-f57e7000adac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.131411 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b19f6c8d-99db-48a9-b0bd-f57e7000adac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.133991 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b19f6c8d-99db-48a9-b0bd-f57e7000adac admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.135076 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-b19f6c8d-99db-48a9-b0bd-f57e7000adac admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/4bb7c22a-77c1-41bb-b3d7-1586390e6999 HTTP/1.1" status: 204 len: 168 time: 0.1374586 Sep 16 16:23:39.143111 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19f6c8d-99db-48a9-b0bd-f57e7000adac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bb7c22a-77c1-41bb-b3d7-1586390e6999,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:39.307063 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-213491610-network', 'tenant_id': '6560ff6c16c54d39bd054561aad63a12'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:39.339762 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Made reservation on behalf of 6560ff6c16c54d39bd054561aad63a12 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:39.342425 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.351603 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.489865 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.498934 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.521732 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 745} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:23:39.547475 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60310e92-2158-42db-82b3-627264f1e8f4 req-c49cd169-2546-4567-b570-74b6bce11f5a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:39.548998 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-60310e92-2158-42db-82b3-627264f1e8f4 req-c49cd169-2546-4567-b570-74b6bce11f5a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0984747 Sep 16 16:23:39.553070 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.553395 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Added segment dd570390-2af3-48dd-9731-814c63fe3614 of type vlan for network bbef521b-499c-40f5-ae34-4960093b92d7 Sep 16 16:23:39.554764 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ddb3a6a7-7f18-4dc3-a328-46698c8b8430,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:39.623062 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.634875 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-60310e92-2158-42db-82b3-627264f1e8f4 req-ea685594-8537-4c90-bf77-241160fb2227 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771787 Sep 16 16:23:39.666502 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.668102 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:39.669497 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.722753 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38258) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:39.723762 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.6594896 Sep 16 16:23:39.729237 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Request body: {'subnet': {'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-213491610-subnet', 'tenant_id': '6560ff6c16c54d39bd054561aad63a12', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:39.754387 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e62f01f3-63a1-4192-9c47-7358f178184b up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:23:39.788380 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b54e216-c1dd-430b-be2b-a231797615fc req-e6e941aa-1188-4aff-b453-b0c6648655ec tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:39.789951 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8b54e216-c1dd-430b-be2b-a231797615fc req-e6e941aa-1188-4aff-b453-b0c6648655ec tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 949 time: 0.0991869 Sep 16 16:23:39.790716 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795fb8f7-3b05-4dc2-a47e-2c0b16f8f5a6 admin admin] Pushing event updated for resources: {'Network': ['ID=bbef521b-499c-40f5-ae34-4960093b92d7,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:39.790841 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Made reservation on behalf of 6560ff6c16c54d39bd054561aad63a12 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:39.793452 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58434343'] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.810333 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network bbef521b-499c-40f5-ae34-4960093b92d7 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:23:39.925227 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port e62f01f3-63a1-4192-9c47-7358f178184b completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:23:39.931064 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port e62f01f3-63a1-4192-9c47-7358f178184b triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:23:39.931528 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:39.943105 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8b54e216-c1dd-430b-be2b-a231797615fc req-dcbfbf7b-5715-49a6-8ba7-a312f8cb8bd8 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717955 Sep 16 16:23:40.054697 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.136912 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9661d565-0e27-4d88-ac99-e62d7d283a57 req-b0d9a4a3-b051-4645-8e4b-bb941786ee00 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:40.142051 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9661d565-0e27-4d88-ac99-e62d7d283a57 req-b0d9a4a3-b051-4645-8e4b-bb941786ee00 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 944 time: 0.1216812 Sep 16 16:23:40.193028 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-58361794', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58434313'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.197996 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9661d565-0e27-4d88-ac99-e62d7d283a57 req-947704c1-2a7e-459c-9b7b-7737fba956d8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510724 Sep 16 16:23:40.270041 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e62f01f3-63a1-4192-9c47-7358f178184b'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:40.273276 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0c9778a-51d3-4fa1-93ba-3f1bcae731bb" -d '{"events": [{"server_uuid": "b4de9ca9-e65c-4e85-9cff-dd6c718b10e3", "name": "network-vif-plugged", "status": "completed", "tag": "e62f01f3-63a1-4192-9c47-7358f178184b"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:40.306101 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port e62f01f3-63a1-4192-9c47-7358f178184b, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e62f01f3-63a1-4192-9c47-7358f178184b,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:40.315780 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.317147 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2e8be2b9-b510-43fb-8639-92b3f61018ba up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:23:40.337012 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Pushing event updated for resources: {'Subnet': ['ID=dd7da63f-e08a-4fc1-87c9-93051b7a7b60,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:40.354744 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-88af0921-bdb2-47bb-92cf-2ed185899c3c x-openstack-request-id: req-88af0921-bdb2-47bb-92cf-2ed185899c3c {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:40.355049 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4de9ca9-e65c-4e85-9cff-dd6c718b10e3", "name": "network-vif-plugged", "status": "completed", "tag": "e62f01f3-63a1-4192-9c47-7358f178184b", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:40.355359 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-88af0921-bdb2-47bb-92cf-2ed185899c3c {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:40.356883 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Checking segment: {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:40.357757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Network hostable DHCP agents. Network: bbef521b-499c-40f5-ae34-4960093b92d7, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:23:40.363029 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e62f01f3-63a1-4192-9c47-7358f178184b', 'code': 200} Sep 16 16:23:40.389210 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Network bbef521b-499c-40f5-ae34-4960093b92d7 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:23:40.408316 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, bbef521b-499c-40f5-ae34-4960093b92d7) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:40.421144 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=e62f01f3-63a1-4192-9c47-7358f178184b,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:40.427068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:40.427780 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.429161 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58f85f0b-8e07-44d3-8127-8a07511da9ab None None] Network bbef521b-499c-40f5-ae34-4960093b92d7 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:40.448880 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-494bbb1f-6c95-45b4-ada2-c2ee1eea3e9a admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7248166 Sep 16 16:23:40.532007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port 2e8be2b9-b510-43fb-8639-92b3f61018ba completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:23:40.556542 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port 2e8be2b9-b510-43fb-8639-92b3f61018ba triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:23:40.557157 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.592806 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91f10112-b0ca-4091-9ac2-e505adc16f1f req-658d8dcc-93f2-4050-9729-e4c892afb5ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:40.594616 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-91f10112-b0ca-4091-9ac2-e505adc16f1f req-658d8dcc-93f2-4050-9729-e4c892afb5ee service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 1098 time: 0.0554090 Sep 16 16:23:40.613455 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7affaa2a-08b2-47e1-a1cb-32da71a852da None None] Network bbef521b-499c-40f5-ae34-4960093b92d7 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:40.653077 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-91f10112-b0ca-4091-9ac2-e505adc16f1f req-a95fde78-fd6d-402a-8ded-e5cb258f8b0f service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424812 Sep 16 16:23:40.764792 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f12157-e1f5-466d-8d3f-9abb512f876d req-c52be5f5-3cee-4ed5-97bf-dd8060d5b456 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:40.767247 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d8f12157-e1f5-466d-8d3f-9abb512f876d req-c52be5f5-3cee-4ed5-97bf-dd8060d5b456 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0617743 Sep 16 16:23:40.816641 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.831836 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d8f12157-e1f5-466d-8d3f-9abb512f876d req-724f0a9f-6464-4a92-8903-f0f2e2b153ae tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548429 Sep 16 16:23:40.870351 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2e8be2b9-b510-43fb-8639-92b3f61018ba, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2e8be2b9-b510-43fb-8639-92b3f61018ba,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:40.875712 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:40.938730 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=2e8be2b9-b510-43fb-8639-92b3f61018ba,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:41.041374 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38328) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:41.069221 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88599690-8952-455a-9843-b69e73b4d7e2 req-a2e09e62-6f1f-4a66-bea8-24a74d8d7034 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:41.075817 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-88599690-8952-455a-9843-b69e73b4d7e2 req-a2e09e62-6f1f-4a66-bea8-24a74d8d7034 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.0687699 Sep 16 16:23:41.117982 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-88599690-8952-455a-9843-b69e73b4d7e2 req-42a7f0f5-3515-49ee-be48-cf729d052ed5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397606 Sep 16 16:23:41.304660 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c3093895-1ed2-437d-a41e-c2758a0b58fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.368580 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdbb9298-7d03-481c-8c05-e2a7dc6103d1 req-b6c87378-cf6d-49c7-8d23-f5543a3b279e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:41.370157 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fdbb9298-7d03-481c-8c05-e2a7dc6103d1 req-b6c87378-cf6d-49c7-8d23-f5543a3b279e tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 945 time: 0.0650816 Sep 16 16:23:41.430739 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c3093895-1ed2-437d-a41e-c2758a0b58fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.431816 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fdbb9298-7d03-481c-8c05-e2a7dc6103d1 req-28d11f7b-0d20-43fc-8352-67a00f5b5549 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447421 Sep 16 16:23:41.449179 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c3093895-1ed2-437d-a41e-c2758a0b58fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.483237 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c3093895-1ed2-437d-a41e-c2758a0b58fc admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=51b1ad3fe7354869a9ab9b714e720a3f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4406223 Sep 16 16:23:41.485797 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38360) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:41.496435 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3093895-1ed2-437d-a41e-c2758a0b58fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=935093b5-c8ba-49f4-b232-feb51f0b6e57,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:41.541814 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7da0c20d-e72e-487c-9d59-2229690b6e53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.563748 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7da0c20d-e72e-487c-9d59-2229690b6e53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.630116 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7da0c20d-e72e-487c-9d59-2229690b6e53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.633740 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7da0c20d-e72e-487c-9d59-2229690b6e53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:41.635178 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-7da0c20d-e72e-487c-9d59-2229690b6e53 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/935093b5-c8ba-49f4-b232-feb51f0b6e57 HTTP/1.1" status: 204 len: 168 time: 0.1481040 Sep 16 16:23:41.644303 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da0c20d-e72e-487c-9d59-2229690b6e53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=935093b5-c8ba-49f4-b232-feb51f0b6e57,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:41.987625 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8f5e91-b072-462e-a1ef-1d6868bf1080 req-be6739c0-1a9c-4525-b27e-e9da766824aa tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:41.989873 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ba8f5e91-b072-462e-a1ef-1d6868bf1080 req-be6739c0-1a9c-4525-b27e-e9da766824aa tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0651767 Sep 16 16:23:42.047784 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ba8f5e91-b072-462e-a1ef-1d6868bf1080 req-b49f6185-e34c-4e7b-92e4-4abf41443109 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507629 Sep 16 16:23:42.077579 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38404) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:42.095507 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e7027aff-4f9f-477e-a0aa-38120b31f905 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.217104 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e7027aff-4f9f-477e-a0aa-38120b31f905 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.225871 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e7027aff-4f9f-477e-a0aa-38120b31f905 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.259907 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e7027aff-4f9f-477e-a0aa-38120b31f905 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=b49371bf27554fab868f1962295b126b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1811948 Sep 16 16:23:42.262479 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38412) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:42.263918 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49fdc249-fcca-47eb-bc91-39180a2a1096 req-a3baf680-d3bc-44b1-b716-de6a88336b9e tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:42.283631 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-49fdc249-fcca-47eb-bc91-39180a2a1096 req-a3baf680-d3bc-44b1-b716-de6a88336b9e tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.0700817 Sep 16 16:23:42.331912 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7027aff-4f9f-477e-a0aa-38120b31f905 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61ae7b61-6c0e-4743-bcce-347bceb70f52,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:42.335740 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69e2f83b-df91-48fe-8fc5-796a32008cde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.358538 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-49fdc249-fcca-47eb-bc91-39180a2a1096 req-f40a97f5-c989-4090-bc86-f91d1dca8b54 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739686 Sep 16 16:23:42.362235 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69e2f83b-df91-48fe-8fc5-796a32008cde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.363818 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2e8be2b9-b510-43fb-8639-92b3f61018ba'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:42.367082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29f53aa4-6884-4ca1-bdf3-0ab11e8a625d" -d '{"events": [{"server_uuid": "c110f9bd-0c58-447a-86db-65c9090abc8b", "name": "network-vif-plugged", "status": "completed", "tag": "2e8be2b9-b510-43fb-8639-92b3f61018ba"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:42.379626 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38424) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:42.422028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dcd6b3d6-d244-49a9-912b-87994fb598a1 x-openstack-request-id: req-dcd6b3d6-d244-49a9-912b-87994fb598a1 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:42.422319 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c110f9bd-0c58-447a-86db-65c9090abc8b", "name": "network-vif-plugged", "status": "completed", "tag": "2e8be2b9-b510-43fb-8639-92b3f61018ba", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:42.422578 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-dcd6b3d6-d244-49a9-912b-87994fb598a1 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:42.422970 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2e8be2b9-b510-43fb-8639-92b3f61018ba', 'code': 200} Sep 16 16:23:42.454519 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69e2f83b-df91-48fe-8fc5-796a32008cde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.457528 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69e2f83b-df91-48fe-8fc5-796a32008cde admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.458746 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-69e2f83b-df91-48fe-8fc5-796a32008cde admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/61ae7b61-6c0e-4743-bcce-347bceb70f52 HTTP/1.1" status: 204 len: 168 time: 0.1950796 Sep 16 16:23:42.477118 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e2f83b-df91-48fe-8fc5-796a32008cde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61ae7b61-6c0e-4743-bcce-347bceb70f52,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:42.592261 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-81303313-e406-47eb-b8db-9c1e00d8906c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.658346 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b714953-93ae-4925-b959-0c71023595a3 req-8b20a6e1-1e91-4378-b892-c99e95bbab41 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:42.666675 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0b714953-93ae-4925-b959-0c71023595a3 req-8b20a6e1-1e91-4378-b892-c99e95bbab41 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 945 time: 0.1466231 Sep 16 16:23:42.730628 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5ce55c-2e59-4c17-a692-f6ad5f654510 req-0dbe76b8-c17d-4936-922d-fd56b64ac84f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:42.732352 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bc5ce55c-2e59-4c17-a692-f6ad5f654510 req-0dbe76b8-c17d-4936-922d-fd56b64ac84f service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 1103 time: 0.1249418 Sep 16 16:23:42.737300 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-a2270260-ff9f-43a1-91c5-2869b9b2284d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:42.744936 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0b714953-93ae-4925-b959-0c71023595a3 req-497f5673-8e0d-4d0e-838a-9c091fa754fe tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771048 Sep 16 16:23:42.746377 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-a2270260-ff9f-43a1-91c5-2869b9b2284d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/networks?id=bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 200 len: 813 time: 0.1502724 Sep 16 16:23:42.775931 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-036eb7a4-6d06-44e3-89ac-abb23f08c3a0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/quotas/6560ff6c16c54d39bd054561aad63a12 HTTP/1.1" status: 200 len: 375 time: 0.0285885 Sep 16 16:23:42.814928 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bc5ce55c-2e59-4c17-a692-f6ad5f654510 req-315e9a0d-a51d-4a9b-bee4-1be51d6cffb0 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634537 Sep 16 16:23:42.841594 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-411273a9-98d9-4a70-b60d-1abaaa688398 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=6560ff6c16c54d39bd054561aad63a12&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0564866 Sep 16 16:23:42.841789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-81303313-e406-47eb-b8db-9c1e00d8906c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.855560 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-81303313-e406-47eb-b8db-9c1e00d8906c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:42.903702 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38456) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:42.904368 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-81303313-e406-47eb-b8db-9c1e00d8906c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=203df9071ea94e93bf2bba09ba22fbd3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5236437 Sep 16 16:23:42.906504 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81303313-e406-47eb-b8db-9c1e00d8906c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c09a5918-8697-4900-bb6f-32cae6e0d2bf,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:43.006643 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-f6e60c70-0592-4fff-874a-cfb9b4800a43 service neutron] 10.222.0.59 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1636503 Sep 16 16:23:43.025948 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-46c52694-594d-4993-a8d5-ac121606273f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.164713 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-46c52694-594d-4993-a8d5-ac121606273f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.181348 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-2d0cd6c4-ac6b-4cbc-ae50-378566603a27 service neutron] 10.222.0.59 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1645505 Sep 16 16:23:43.234419 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-46c52694-594d-4993-a8d5-ac121606273f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.235387 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afdb2562-4336-4e98-8660-4a9c52b3e6eb req-72e91841-6cc0-4972-9def-30e1213f87c1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:43.237599 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-46c52694-594d-4993-a8d5-ac121606273f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.239600 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-46c52694-594d-4993-a8d5-ac121606273f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c09a5918-8697-4900-bb6f-32cae6e0d2bf HTTP/1.1" status: 204 len: 168 time: 0.3348153 Sep 16 16:23:43.246265 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-afdb2562-4336-4e98-8660-4a9c52b3e6eb req-72e91841-6cc0-4972-9def-30e1213f87c1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1067176 Sep 16 16:23:43.254133 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c52694-594d-4993-a8d5-ac121606273f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c09a5918-8697-4900-bb6f-32cae6e0d2bf,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:43.296692 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-afdb2562-4336-4e98-8660-4a9c52b3e6eb req-c8cf8b28-4f0a-4df2-b879-0e632a2ce46f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495121 Sep 16 16:23:43.403017 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c0152d39-0cf5-47a8-a5eb-baee1ebf6ba2 req-b941ec7d-b65d-4db3-8714-9ca22f67b452 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 210 time: 0.0289235 Sep 16 16:23:43.514097 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51023e6b-e8a0-481c-b5b7-78099675df9f req-f65ca2cd-44c3-4cca-85d8-666f8f8bfc2f tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:43.515741 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-51023e6b-e8a0-481c-b5b7-78099675df9f req-f65ca2cd-44c3-4cca-85d8-666f8f8bfc2f tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.0598686 Sep 16 16:23:43.562763 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-51023e6b-e8a0-481c-b5b7-78099675df9f req-35cb638d-a5bf-456a-b4b0-49ec8c4298e5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376620 Sep 16 16:23:43.639416 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38494) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:43.649591 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38498) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:43.662240 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3298c6de-e64d-4458-a041-e81c80c97cd6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.764174 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3298c6de-e64d-4458-a041-e81c80c97cd6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.768361 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3298c6de-e64d-4458-a041-e81c80c97cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.811536 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3298c6de-e64d-4458-a041-e81c80c97cd6 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=154d0f9e726d478b9fb50609d46902c6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1609123 Sep 16 16:23:43.812356 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3298c6de-e64d-4458-a041-e81c80c97cd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3e4a160-b77a-4edd-a3a2-6ef3bc2434d2,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:43.814414 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38502) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:43.868711 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1041581015-network', 'tenant_id': 'f5178fe3547b432792996a0b47d8a025'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:43.879550 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-548f13c5-9bb7-480a-b4ce-688064882da0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.888720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Made reservation on behalf of f5178fe3547b432792996a0b47d8a025 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:43.891463 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.900644 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.910273 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-548f13c5-9bb7-480a-b4ce-688064882da0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.965012 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-548f13c5-9bb7-480a-b4ce-688064882da0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.972572 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-548f13c5-9bb7-480a-b4ce-688064882da0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:43.974480 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-548f13c5-9bb7-480a-b4ce-688064882da0 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e3e4a160-b77a-4edd-a3a2-6ef3bc2434d2 HTTP/1.1" status: 204 len: 168 time: 0.1582327 Sep 16 16:23:43.988250 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548f13c5-9bb7-480a-b4ce-688064882da0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3e4a160-b77a-4edd-a3a2-6ef3bc2434d2,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:44.041276 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.046397 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.072935 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 738} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:23:44.089985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=994c0e1d-ee8c-408f-bc54-75e786c084ab,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:44.094436 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.095342 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Added segment abe40faa-ea6a-4cb2-b2fb-49b96ee48698 of type vlan for network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 Sep 16 16:23:44.142291 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.180156 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.182635 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:44.184086 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.234094 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38516) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:44.239609 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Request body: {'subnet': {'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1041581015-subnet', 'tenant_id': 'f5178fe3547b432792996a0b47d8a025', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:44.250220 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6052449 Sep 16 16:23:44.270377 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Made reservation on behalf of f5178fe3547b432792996a0b47d8a025 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:44.273515 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58434343'] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.296542 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff2327c-fd94-4c65-a229-39d16ca9d9bc admin admin] Pushing event updated for resources: {'Network': ['ID=6552c4e5-d945-44f2-a079-8db3b3dd41c5,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:44.308807 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:23:44.527441 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-58361794', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58434313'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.587828 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ca75cd-5dea-4ec1-8fdf-3167f1f069a0 req-1776a6bf-fc24-4695-a39f-6ba36bd087a7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:44.589525 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04ca75cd-5dea-4ec1-8fdf-3167f1f069a0 req-1776a6bf-fc24-4695-a39f-6ba36bd087a7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1056421 Sep 16 16:23:44.614514 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a059b6f3-51b1-44ce-96d4-f56363397303,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:44.641864 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Checking segment: {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:44.642217 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Network hostable DHCP agents. Network: 6552c4e5-d945-44f2-a079-8db3b3dd41c5, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:23:44.671725 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04ca75cd-5dea-4ec1-8fdf-3167f1f069a0 req-5e6cfe5d-f18a-46dd-9cdd-c9cdfe5ff921 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654302 Sep 16 16:23:44.674887 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:23:44.696736 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 6552c4e5-d945-44f2-a079-8db3b3dd41c5) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:44.711346 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddf73c82-afaf-40d5-a171-2a327a6e0397 None None] Network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:44.775580 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:44.784153 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:44.788140 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6b3f14e4-aadf-41fc-9983-a9c3510513e5 req-daec77e4-df1e-4316-9581-4938b4caaaf5 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 210 time: 0.0723355 Sep 16 16:23:44.910667 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0380901b-c2a2-4802-af8e-3866054d1461 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6678450 Sep 16 16:23:44.931480 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8800ab3d-e45e-4d7d-9077-c2db0af0b7ba req-1501fa10-74ba-4b6d-b8d2-f169fd9458aa tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:44.935406 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bf37d98-0533-44ff-848f-3ff54a5c5ba1 None None] Network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:44.940218 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8800ab3d-e45e-4d7d-9077-c2db0af0b7ba req-1501fa10-74ba-4b6d-b8d2-f169fd9458aa tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.1114304 Sep 16 16:23:44.992963 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-596e743e-eba2-45ca-aa19-33d039533ca5 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:44.995229 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-596e743e-eba2-45ca-aa19-33d039533ca5 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "GET /v2.0/networks?id=bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 200 len: 813 time: 0.3009071 Sep 16 16:23:45.039075 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8800ab3d-e45e-4d7d-9077-c2db0af0b7ba req-b24f8aab-217d-46b1-984d-e3f54af30f67 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934095 Sep 16 16:23:45.047964 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38558) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:45.057931 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Request body: {'port': {'device_id': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7', 'admin_state_up': True, 'tenant_id': '6560ff6c16c54d39bd054561aad63a12'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:45.148808 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.176156 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1928660497-network', 'tenant_id': 'e148e600eab7455ea277ffbe9337d07f'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:45.189414 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.db.api [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 16 16:23:45.189414 dv-cinder-805887-15-iscsi neutron-server[93950]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Sep 16 16:23:45.189414 dv-cinder-805887-15-iscsi neutron-server[93950]: [parameters: {'project_id': 'e148e600eab7455ea277ffbe9337d07f', 'id': '23704c28-d794-41ff-a79c-e0a6f7e49017', 'expiration': datetime.datetime(2021, 9, 16, 16, 25, 45, 186029)}] Sep 16 16:23:45.189414 dv-cinder-805887-15-iscsi neutron-server[93950]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=93950) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 16 16:23:45.189764 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG oslo_db.api [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 16 16:23:45.196990 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Made reservation on behalf of 6560ff6c16c54d39bd054561aad63a12 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:45.200896 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.337744 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Allocated IP 172.20.0.10 (bbef521b-499c-40f5-ae34-4960093b92d7/dd7da63f-e08a-4fc1-87c9-93051b7a7b60/2f874a79-207c-4bb2-b345-a04463be9822) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:23:45.526091 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.570315 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.645488 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Network bbef521b-499c-40f5-ae34-4960093b92d7 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:23:45.651497 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:45.653717 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:23:45.664118 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Pushing event updated for resources: {'Port': ['ID=2f874a79-207c-4bb2-b345-a04463be9822,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:45.708506 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c7ab75-064c-406f-9df7-7802fa3d3fc1 req-4c6f35f8-7bbb-4648-a1bb-9cefca1da1b5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:45.710672 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-77c7ab75-064c-406f-9df7-7802fa3d3fc1 req-4c6f35f8-7bbb-4648-a1bb-9cefca1da1b5 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.1002388 Sep 16 16:23:45.719587 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Made reservation on behalf of e148e600eab7455ea277ffbe9337d07f for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:45.722712 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.730361 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:45.730996 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.743801 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.765324 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9c2a1957-bddf-4913-9ac4-0ebdedbdf48a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7251534 Sep 16 16:23:45.773483 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-77c7ab75-064c-406f-9df7-7802fa3d3fc1 req-bbbb24ed-841d-49a0-b48e-5f2d78d09308 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513380 Sep 16 16:23:45.795815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Request body: {'port': {'device_id': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:45.872519 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec07759-56de-4389-a01a-5a340b0d366b req-9cb3934f-5d03-4fdf-aab9-ae685521db37 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:45.873091 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.874037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fec07759-56de-4389-a01a-5a340b0d366b req-9cb3934f-5d03-4fdf-aab9-ae685521db37 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0904105 Sep 16 16:23:45.937612 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fec07759-56de-4389-a01a-5a340b0d366b req-92fc8f5a-d355-4bfa-991f-12e6261b0297 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568991 Sep 16 16:23:45.942479 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.949953 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.975809 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 746} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:23:45.991924 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9944647-5ba5-42d5-ac21-43edd349e517,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:45.996072 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d430683-1b34-438d-b646-102e041b4833 req-d6cc9de0-18c2-4968-ae8a-ae59e7a57c60 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:45.997922 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2d430683-1b34-438d-b646-102e041b4833 req-d6cc9de0-18c2-4968-ae8a-ae59e7a57c60 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 932 time: 0.0846734 Sep 16 16:23:45.999576 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:45.999927 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Added segment d4c11d33-6318-4ead-b709-aaa3d7dec911 of type vlan for network 98a3fd80-6f2d-45c7-abee-728e73c69fbb Sep 16 16:23:46.043482 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.069202 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.075150 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.078959 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.102640 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2d430683-1b34-438d-b646-102e041b4833 req-62fa9778-9eea-46ed-9378-a16cf5188bab tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579627 Sep 16 16:23:46.110000 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.0590518 Sep 16 16:23:46.111200 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38608) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:46.119444 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Request body: {'subnet': {'network_id': '98a3fd80-6f2d-45c7-abee-728e73c69fbb', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1928660497-subnet', 'tenant_id': 'e148e600eab7455ea277ffbe9337d07f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:46.152463 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a76b65-10a9-44a0-b7ca-b4897f1cee05 admin admin] Pushing event updated for resources: {'Network': ['ID=98a3fd80-6f2d-45c7-abee-728e73c69fbb,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:46.163192 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 98a3fd80-6f2d-45c7-abee-728e73c69fbb details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:23:46.168590 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Made reservation on behalf of e148e600eab7455ea277ffbe9337d07f for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:46.171094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64151728'] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.267886 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f874a79-207c-4bb2-b345-a04463be9822 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:46.275733 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.287733 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Transition to ACTIVE for port object 2f874a79-207c-4bb2-b345-a04463be9822 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:23:46.292926 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.344077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Pushing event updated for resources: {'Port': ['ID=2f874a79-207c-4bb2-b345-a04463be9822,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:46.361731 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-65205906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64151710'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.414503 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Attempting to bind port 2f874a79-207c-4bb2-b345-a04463be9822 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:23:46.414928 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Attempting to bind port 2f874a79-207c-4bb2-b345-a04463be9822 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:23:46.415293 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Attempting to bind port 2f874a79-207c-4bb2-b345-a04463be9822 on network bbef521b-499c-40f5-ae34-4960093b92d7 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:46.416331 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5d4f6eb2-1d35-4864-bb8e-46b8ccaaae5f,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:46.419621 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Port 2f874a79-207c-4bb2-b345-a04463be9822 on network bbef521b-499c-40f5-ae34-4960093b92d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:23:46.419938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Attempting to bind port 2f874a79-207c-4bb2-b345-a04463be9822 on network bbef521b-499c-40f5-ae34-4960093b92d7 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:46.424914 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 23, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:23:46.425270 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Checking segment: {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:46.425710 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Bound using segment: {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:23:46.426030 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Bound port: 2f874a79-207c-4bb2-b345-a04463be9822, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:23:46.426381 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.426741 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Checking segment: {'id': 'd4c11d33-6318-4ead-b709-aaa3d7dec911', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 746, 'network_id': '98a3fd80-6f2d-45c7-abee-728e73c69fbb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:46.427094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Network hostable DHCP agents. Network: 98a3fd80-6f2d-45c7-abee-728e73c69fbb, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:23:46.444862 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Network 98a3fd80-6f2d-45c7-abee-728e73c69fbb is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:23:46.452657 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 98a3fd80-6f2d-45c7-abee-728e73c69fbb) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:46.461597 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.462185 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.462528 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c899b917-b88c-483d-9948-c90de8350edb None None] Network 98a3fd80-6f2d-45c7-abee-728e73c69fbb requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:46.476811 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-58041ebb-50f3-4bf2-92ab-c20c9277d123 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3627682 Sep 16 16:23:46.502986 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] For port 2f874a79-207c-4bb2-b345-a04463be9822, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:23:46.506878 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] For port 2f874a79-207c-4bb2-b345-a04463be9822, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f874a79-207c-4bb2-b345-a04463be9822,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:23:46.512250 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.548470 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.549099 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:46.550495 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] 10.222.0.66 "PUT /v2.0/ports/2f874a79-207c-4bb2-b345-a04463be9822 HTTP/1.1" status: 200 len: 1094 time: 0.7694857 Sep 16 16:23:46.551071 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'tag': '2f874a79-207c-4bb2-b345-a04463be9822'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:46.553382 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36159e6a-2169-4033-9eaf-f4a0e6a369cf" -d '{"events": [{"name": "network-changed", "server_uuid": "af27223f-6b95-4186-88b6-dc57e7f510b7", "tag": "2f874a79-207c-4bb2-b345-a04463be9822"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:46.590094 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f451db7-1c64-482d-8385-27249a6b3e96 service neutron] Pushing event updated for resources: {'Port': ['ID=2f874a79-207c-4bb2-b345-a04463be9822,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:46.605584 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87d396f5-3049-4d6d-b1e4-33c8f6e44f19 None None] Network 98a3fd80-6f2d-45c7-abee-728e73c69fbb requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:46.645431 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4af1234-edb7-4e78-84d7-705ba8a47bd6 x-openstack-request-id: req-a4af1234-edb7-4e78-84d7-705ba8a47bd6 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:46.645716 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "af27223f-6b95-4186-88b6-dc57e7f510b7", "tag": "2f874a79-207c-4bb2-b345-a04463be9822", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:46.645957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-a4af1234-edb7-4e78-84d7-705ba8a47bd6 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:46.646335 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'tag': '2f874a79-207c-4bb2-b345-a04463be9822', 'status': 'completed', 'code': 200} Sep 16 16:23:46.676352 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-e0a40240-9043-4434-9b4e-c6614fe881ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.678051 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-e0a40240-9043-4434-9b4e-c6614fe881ee service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=6560ff6c16c54d39bd054561aad63a12&device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 1097 time: 0.0490751 Sep 16 16:23:46.743955 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-7666da0f-57e6-4d43-b0fc-0d1548cfefc3 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2f874a79-207c-4bb2-b345-a04463be9822 HTTP/1.1" status: 200 len: 217 time: 0.0527136 Sep 16 16:23:46.839605 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-fa3ecb56-9750-439e-afbf-f2970070874c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.841223 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-fa3ecb56-9750-439e-afbf-f2970070874c service neutron] 10.222.0.66 "GET /v2.0/subnets?id=dd7da63f-e08a-4fc1-87c9-93051b7a7b60 HTTP/1.1" status: 200 len: 853 time: 0.0642102 Sep 16 16:23:46.849426 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-d5f5351d-10e5-4b18-9a2c-bef781197803 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.850854 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-d5f5351d-10e5-4b18-9a2c-bef781197803 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/networks?id=6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 200 len: 809 time: 0.1700697 Sep 16 16:23:46.893451 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-3f720f4b-04b4-4d48-ab0b-8c4d17b88baa service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=bbef521b-499c-40f5-ae34-4960093b92d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343518 Sep 16 16:23:46.894821 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-b147d4c6-d608-4f32-8554-64d9e7842386 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/quotas/f5178fe3547b432792996a0b47d8a025 HTTP/1.1" status: 200 len: 375 time: 0.0375330 Sep 16 16:23:46.929920 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eee8f54-bd05-4d62-97cb-94569b7ab079 req-e98a5a4f-ffdf-4ee3-9273-316558b26133 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:46.935692 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7eee8f54-bd05-4d62-97cb-94569b7ab079 req-e98a5a4f-ffdf-4ee3-9273-316558b26133 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.0712283 Sep 16 16:23:46.955269 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-1d7fd137-dfb9-4541-a6da-c8ae09fd1eb6 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=f5178fe3547b432792996a0b47d8a025&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0430665 Sep 16 16:23:46.972247 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7eee8f54-bd05-4d62-97cb-94569b7ab079 req-65cf8e9c-1241-46ab-9971-f0285e0cdcec tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347316 Sep 16 16:23:47.093502 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-9a8dfdf8-5bb6-429b-b6b0-01393dfcd3f6 service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1798444 Sep 16 16:23:47.101047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3047d22-0dcc-4763-a5c9-6683c2204676 req-874e06fe-b219-45c3-bdec-f98a196cff51 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.104053 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b3047d22-0dcc-4763-a5c9-6683c2204676 req-874e06fe-b219-45c3-bdec-f98a196cff51 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0755002 Sep 16 16:23:47.147347 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-3f962c77-2bf5-4b84-b1c3-f8922711b93f service neutron] 10.222.0.59 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1808808 Sep 16 16:23:47.148143 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b3047d22-0dcc-4763-a5c9-6683c2204676 req-22053b85-9ada-460d-8cee-60aba4b74013 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364838 Sep 16 16:23:47.259095 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38660) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:47.264047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1980935063-network', 'tenant_id': 'a38e00db3c2641e4987b5ea52e4c8ce6'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:47.278313 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-616e9deb-ed94-453c-adfe-eecf5b8fa7d2 req-76b609d5-54e9-4571-9ed9-3eca9fb5257b service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1741903 Sep 16 16:23:47.304398 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-3e875cd4-bf31-4c6c-811b-c397b40e38c9 service neutron] 10.222.0.59 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1508517 Sep 16 16:23:47.316550 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Made reservation on behalf of a38e00db3c2641e4987b5ea52e4c8ce6 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:47.320166 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.334152 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806de491-dfc2-4caa-abcf-62684b3bc2ed req-e5ecc3e3-5467-4659-abe4-337749cbb0af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.336262 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-806de491-dfc2-4caa-abcf-62684b3bc2ed req-e5ecc3e3-5467-4659-abe4-337749cbb0af service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0656865 Sep 16 16:23:47.337581 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.418380 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-806de491-dfc2-4caa-abcf-62684b3bc2ed req-99951369-5a40-46f3-b6a2-ab801c41eeec service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404987 Sep 16 16:23:47.439326 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38664) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:47.476463 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-7268cc5b-4436-4a82-ab52-c0c474b5a95c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.478553 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-7268cc5b-4436-4a82-ab52-c0c474b5a95c service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=6560ff6c16c54d39bd054561aad63a12&device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 1097 time: 0.1006193 Sep 16 16:23:47.512818 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5539037a-4d82-4c5c-9ea8-fad4404d8c9a req-75c94ce6-2c3b-48b7-a327-f39bb0aa781b tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 210 time: 0.0292509 Sep 16 16:23:47.539568 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.552411 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea6413c-0b19-4357-b979-10e176253e36 req-1ef0f515-e57a-4e44-a025-b1de0ae00000 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.563332 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0ea6413c-0b19-4357-b979-10e176253e36 req-1ef0f515-e57a-4e44-a025-b1de0ae00000 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 944 time: 0.0704463 Sep 16 16:23:47.566341 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.606814 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 722} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:23:47.608809 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a84e3d9-6e55-4a87-83bd-181b2a51d7ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.656328 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.656666 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Added segment 6b881510-9da1-4e23-bf9b-ca0ed3e3e7e7 of type vlan for network 882d9a4e-311e-49c9-b958-2ed88f100bb3 Sep 16 16:23:47.659562 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fdefe91-2fc3-49e7-b26c-771bcc0be79e,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:47.673717 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0ea6413c-0b19-4357-b979-10e176253e36 req-6546bf1e-3804-4c79-8706-3ad740b13954 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095030 Sep 16 16:23:47.721575 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.762416 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-675036eb-8ef4-4873-9516-aa23ed8b4ec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.764118 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-675036eb-8ef4-4873-9516-aa23ed8b4ec1 service neutron] 10.222.0.66 "GET /v2.0/networks?id=bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 200 len: 914 time: 0.1178684 Sep 16 16:23:47.767291 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.768317 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.768824 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.817114 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-26d4e1a7-55a6-41a8-867a-d9284b013240 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2f874a79-207c-4bb2-b345-a04463be9822 HTTP/1.1" status: 200 len: 217 time: 0.0414722 Sep 16 16:23:47.868162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-dc90ace2-0c01-423b-8caf-f0d9ab7124d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.869594 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-dc90ace2-0c01-423b-8caf-f0d9ab7124d5 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=dd7da63f-e08a-4fc1-87c9-93051b7a7b60 HTTP/1.1" status: 200 len: 853 time: 0.0444138 Sep 16 16:23:47.876052 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] Pushing event updated for resources: {'Network': ['ID=882d9a4e-311e-49c9-b958-2ed88f100bb3,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:47.886566 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 882d9a4e-311e-49c9-b958-2ed88f100bb3 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:23:47.888617 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a84e3d9-6e55-4a87-83bd-181b2a51d7ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.899122 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a84e3d9-6e55-4a87-83bd-181b2a51d7ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.918800 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-943f7411-367a-406e-bc9b-c296acbd5f7f admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6563096 Sep 16 16:23:47.919908 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 38680) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:47.923673 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-2031d744-099c-4623-bda3-2c1cda6c7f97 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=bbef521b-499c-40f5-ae34-4960093b92d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0329471 Sep 16 16:23:47.927887 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Request body: {'subnet': {'network_id': '882d9a4e-311e-49c9-b958-2ed88f100bb3', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1980935063-subnet', 'tenant_id': 'a38e00db3c2641e4987b5ea52e4c8ce6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:47.936108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-6d7a7ad9-47b3-4711-bdba-e2481625cd23 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:47.937541 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-6d7a7ad9-47b3-4711-bdba-e2481625cd23 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.66 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.0991156 Sep 16 16:23:47.953144 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3a84e3d9-6e55-4a87-83bd-181b2a51d7ae admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=12dc6e4424774718a949f9d89cfbf596&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5126076 Sep 16 16:23:47.959868 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38682) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:47.962960 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Made reservation on behalf of a38e00db3c2641e4987b5ea52e4c8ce6 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:47.966566 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58434343'] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:47.974289 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a84e3d9-6e55-4a87-83bd-181b2a51d7ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6c709f0-2d96-422b-a452-7436bb762972,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:48.080618 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-92fdd088-dd34-42c1-a89c-4000588f0e49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.110291 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-92fdd088-dd34-42c1-a89c-4000588f0e49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.124057 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Deleting port 2e8be2b9-b510-43fb-8639-92b3f61018ba {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:23:48.124307 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.277691 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-92fdd088-dd34-42c1-a89c-4000588f0e49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.280195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-92fdd088-dd34-42c1-a89c-4000588f0e49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.281333 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-92fdd088-dd34-42c1-a89c-4000588f0e49 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e6c709f0-2d96-422b-a452-7436bb762972 HTTP/1.1" status: 204 len: 168 time: 0.3150020 Sep 16 16:23:48.284584 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] For port 2e8be2b9-b510-43fb-8639-92b3f61018ba, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2e8be2b9-b510-43fb-8639-92b3f61018ba,segment=NetworkSegment(0841e726-8f7e-455b-8c2a-e02eb1bccc87),segment_id=0841e726-8f7e-455b-8c2a-e02eb1bccc87)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:48.284941 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.302807 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fdd088-dd34-42c1-a89c-4000588f0e49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6c709f0-2d96-422b-a452-7436bb762972,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:48.311300 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Calling delete_port for 2e8be2b9-b510-43fb-8639-92b3f61018ba owned by compute:nova {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:23:48.339414 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e0b754-ebe2-4d8b-aa58-04394d72cde4 req-70d81dde-dbe5-41aa-aa5d-cae9fbaa659f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:48.341099 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-73e0b754-ebe2-4d8b-aa58-04394d72cde4 req-70d81dde-dbe5-41aa-aa5d-cae9fbaa659f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1091585 Sep 16 16:23:48.417902 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-73e0b754-ebe2-4d8b-aa58-04394d72cde4 req-2baae9f6-1ded-4c7c-82d6-4d5f1ba9e2d4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488994 Sep 16 16:23:48.455429 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-8f75cbf0-9e53-4ff3-b252-21622b861c8e service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5084069 Sep 16 16:23:48.465888 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a68766-698a-47f5-8d6c-59821d6df0cb req-87e7122c-e1a6-4274-995a-ac54610d7abf tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:48.467515 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-67a68766-698a-47f5-8d6c-59821d6df0cb req-87e7122c-e1a6-4274-995a-ac54610d7abf tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/ports?device_id=c110f9bd-0c58-447a-86db-65c9090abc8b HTTP/1.1" status: 200 len: 950 time: 0.3522644 Sep 16 16:23:48.508114 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.543565 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Pushing event deleted for resources: {'Port': ['ID=2e8be2b9-b510-43fb-8639-92b3f61018ba,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:48.584342 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] No DVR routers for this DVR port 2e8be2b9-b510-43fb-8639-92b3f61018ba on host hv-cinder-80588 {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:23:48.587923 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.590347 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a34c5862-72bf-44b6-883a-eaa704843b5a req-707aaaf7-f1f9-4233-bc79-8dbca05c4f27 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.66 "DELETE /v2.0/ports/2e8be2b9-b510-43fb-8639-92b3f61018ba HTTP/1.1" status: 204 len: 173 time: 0.6357672 Sep 16 16:23:48.590860 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'name': 'network-vif-deleted', 'tag': '2e8be2b9-b510-43fb-8639-92b3f61018ba'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:48.596438 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab7cbb7b-65e4-4fc7-a36f-0c8342f495b0" -d '{"events": [{"server_uuid": "c110f9bd-0c58-447a-86db-65c9090abc8b", "name": "network-vif-deleted", "tag": "2e8be2b9-b510-43fb-8639-92b3f61018ba"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:48.611601 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-67a68766-698a-47f5-8d6c-59821d6df0cb req-22c35c44-b14d-49f1-ba4e-7370d6d2b169 tempest-VolumesNegativeTest-581842655 tempest-VolumesNegativeTest-581842655-project] 10.222.0.59 "GET /v2.0/security-groups?id=c203e23d-8ac4-4859-8784-da907f90655b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1306612 Sep 16 16:23:48.678682 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e919065-7929-42f3-9e30-7f0d14400a99 x-openstack-request-id: req-5e919065-7929-42f3-9e30-7f0d14400a99 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:48.679354 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c110f9bd-0c58-447a-86db-65c9090abc8b", "name": "network-vif-deleted", "tag": "2e8be2b9-b510-43fb-8639-92b3f61018ba", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:48.679607 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-5e919065-7929-42f3-9e30-7f0d14400a99 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:48.680005 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c110f9bd-0c58-447a-86db-65c9090abc8b', 'name': 'network-vif-deleted', 'tag': '2e8be2b9-b510-43fb-8639-92b3f61018ba', 'status': 'completed', 'code': 200} Sep 16 16:23:48.681480 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38698) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:48.699164 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2b09a684-40b9-46a7-85e4-2cbb7b4e8a8a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.727275 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-36159e6a-2169-4033-9eaf-f4a0e6a369cf req-e13df0e1-d9ae-4965-b126-d4812ff3915d service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2587688 Sep 16 16:23:48.732934 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-58361794', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58434313'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.789127 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5fa6913d-8809-4511-9db9-4305d47e3cda req-cfb1260f-6849-4f3b-9179-25b029cc6b0a tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 210 time: 0.0614729 Sep 16 16:23:48.847763 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Pushing event updated for resources: {'Subnet': ['ID=8fa8ecca-16c2-4b16-adda-2e12d18b1725,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:48.865078 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Checking segment: {'id': '6b881510-9da1-4e23-bf9b-ca0ed3e3e7e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 722, 'network_id': '882d9a4e-311e-49c9-b958-2ed88f100bb3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:48.866055 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Network hostable DHCP agents. Network: 882d9a4e-311e-49c9-b958-2ed88f100bb3, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:23:48.885187 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5993358d-5326-4980-81ab-103a645d2f6a req-6d80fcab-923a-411a-a0f1-948ef5823a37 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:48.886707 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5993358d-5326-4980-81ab-103a645d2f6a req-6d80fcab-923a-411a-a0f1-948ef5823a37 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 944 time: 0.1144474 Sep 16 16:23:48.904450 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Network 882d9a4e-311e-49c9-b958-2ed88f100bb3 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:23:48.907095 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2b09a684-40b9-46a7-85e4-2cbb7b4e8a8a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.913335 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2b09a684-40b9-46a7-85e4-2cbb7b4e8a8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.929850 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 882d9a4e-311e-49c9-b958-2ed88f100bb3) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:48.938202 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd295986-5d0c-4cae-a26e-6d39eda5504a None None] Network 882d9a4e-311e-49c9-b958-2ed88f100bb3 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:48.943796 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:48.944373 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:48.967336 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-2b09a684-40b9-46a7-85e4-2cbb7b4e8a8a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f16540db84484f86ac6fc090a6295eae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2842693 Sep 16 16:23:48.968374 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5993358d-5326-4980-81ab-103a645d2f6a req-75c5b301-2e0a-4e52-96cf-cfbe41241932 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708833 Sep 16 16:23:48.969057 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b09a684-40b9-46a7-85e4-2cbb7b4e8a8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bfc28a4-1b4e-4f3c-a689-095b2773abc5,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:48.973423 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38702) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:48.997930 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5e391fa4-d8a1-4df9-b03f-3350b90ade7f admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.0771890 Sep 16 16:23:49.081871 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59e59389-2959-4681-867c-203cb3140292 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.086251 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-66cad1de-e7a3-4d9b-a66a-c5bfdabd1c77 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:49.087998 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-66cad1de-e7a3-4d9b-a66a-c5bfdabd1c77 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "GET /v2.0/networks?id=6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 200 len: 809 time: 0.1487527 Sep 16 16:23:49.112214 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Request body: {'port': {'device_id': 'ea757037-096c-4400-8ff3-7169214e3175', 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5', 'admin_state_up': True, 'tenant_id': 'f5178fe3547b432792996a0b47d8a025'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:49.137011 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59e59389-2959-4681-867c-203cb3140292 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.225357 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59e59389-2959-4681-867c-203cb3140292 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.228729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59e59389-2959-4681-867c-203cb3140292 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.230284 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-59e59389-2959-4681-867c-203cb3140292 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/4bfc28a4-1b4e-4f3c-a689-095b2773abc5 HTTP/1.1" status: 204 len: 168 time: 0.2555776 Sep 16 16:23:49.240666 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-286ae2a2-5aed-49c4-b2f1-a16e3cb55278 None None] Network 882d9a4e-311e-49c9-b958-2ed88f100bb3 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:23:49.246192 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e59389-2959-4681-867c-203cb3140292 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bfc28a4-1b4e-4f3c-a689-095b2773abc5,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:49.258750 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Made reservation on behalf of f5178fe3547b432792996a0b47d8a025 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:23:49.262273 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.426363 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Allocated IP 172.20.0.4 (6552c4e5-d945-44f2-a079-8db3b3dd41c5/a059b6f3-51b1-44ce-96d4-f56363397303/ec469fde-4f83-4483-88eb-713a7a06f69c) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:23:49.631420 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00b2a492-8831-4a34-a3aa-886b714dea5a req-20e61b04-4035-4c22-b0bd-a9581285d8c5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:49.632297 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.636472 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-00b2a492-8831-4a34-a3aa-886b714dea5a req-20e61b04-4035-4c22-b0bd-a9581285d8c5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0944822 Sep 16 16:23:49.692642 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.695979 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-00b2a492-8831-4a34-a3aa-886b714dea5a req-415647ef-f3b6-4af0-81db-2435228fe637 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491941 Sep 16 16:23:49.748134 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38730) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:49.751864 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:23:49.755431 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:23:49.758115 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:23:49.772351 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fcf6cf1a-a5db-4f86-8179-440b30709466 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.820419 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f874a79-207c-4bb2-b345-a04463be9822 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:23:49.823665 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2e8be2b9-b510-43fb-8639-92b3f61018ba no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:23:49.854483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Pushing event updated for resources: {'Port': ['ID=ec469fde-4f83-4483-88eb-713a7a06f69c,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:49.897577 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: 2e8be2b9-b510-43fb-8639-92b3f61018ba {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:23:49.898549 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2e8be2b9-b510-43fb-8639-92b3f61018ba not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:23:49.899854 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:49.901244 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.968977 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fcf6cf1a-a5db-4f86-8179-440b30709466 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:49.976084 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fcf6cf1a-a5db-4f86-8179-440b30709466 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.010309 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4197697b-4e54-4bfe-a4f1-5e59826fb276 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9033272 Sep 16 16:23:50.039617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Request body: {'port': {'device_id': 'ea757037-096c-4400-8ff3-7169214e3175', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:23:50.047035 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-fcf6cf1a-a5db-4f86-8179-440b30709466 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ee186a35169f4c95a666dfa7df9f614d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2953782 Sep 16 16:23:50.047503 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 38752) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:50.053600 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb47a6fd-072d-4100-a1d8-4ca011bb3ba6 req-19e32df7-d4df-482f-bc50-41ae13f772ea tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:50.054306 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf6cf1a-a5db-4f86-8179-440b30709466 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c3d822d-5208-45e0-86ae-9cad2ce86d48,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:50.054550 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2f874a79-207c-4bb2-b345-a04463be9822, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f874a79-207c-4bb2-b345-a04463be9822,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:50.063504 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb47a6fd-072d-4100-a1d8-4ca011bb3ba6 req-19e32df7-d4df-482f-bc50-41ae13f772ea tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 931 time: 0.1267052 Sep 16 16:23:50.070974 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': '2f874a79-207c-4bb2-b345-a04463be9822', 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7', 'port_id': '2f874a79-207c-4bb2-b345-a04463be9822', 'mac_address': 'fa:16:3e:13:79:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 745, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd7da63f-e08a-4fc1-87c9-93051b7a7b60', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:23:50.129310 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.145052 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f874a79-207c-4bb2-b345-a04463be9822 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:50.147417 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb47a6fd-072d-4100-a1d8-4ca011bb3ba6 req-8e3dbb8a-bfce-40c3-a032-66e63b78d450 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772307 Sep 16 16:23:50.178719 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b09187-588d-43f6-8924-03244601397e req-cb815b69-6794-4a1e-bb39-ff14321e0f3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:50.180513 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-cb815b69-6794-4a1e-bb39-ff14321e0f3e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.1270726 Sep 16 16:23:50.187177 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2f874a79-207c-4bb2-b345-a04463be9822, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f874a79-207c-4bb2-b345-a04463be9822,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:50.190768 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1c850898-2d96-4d46-809f-22cbac12e6a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.197524 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.212369 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.255865 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e0752e4-2bdd-42db-8925-97025226da04 req-2d58a92e-5af2-4233-bd6d-6c402d28024c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:50.258127 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7e0752e4-2bdd-42db-8925-97025226da04 req-2d58a92e-5af2-4233-bd6d-6c402d28024c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1561155 Sep 16 16:23:50.271136 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=2f874a79-207c-4bb2-b345-a04463be9822,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:50.398427 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bc4c41-ad0a-4226-a596-522e2207779a req-5edc5c1a-0640-43eb-ba6d-358cf00257a4 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:50.400015 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f8bc4c41-ad0a-4226-a596-522e2207779a req-5edc5c1a-0640-43eb-ba6d-358cf00257a4 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 945 time: 0.1305547 Sep 16 16:23:50.503059 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f8bc4c41-ad0a-4226-a596-522e2207779a req-11d8ed5f-0bfd-4e45-8a6a-29dff48d282b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919290 Sep 16 16:23:50.506396 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1c850898-2d96-4d46-809f-22cbac12e6a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.557260 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f874a79-207c-4bb2-b345-a04463be9822'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:50.579863 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7e0752e4-2bdd-42db-8925-97025226da04 req-372851c1-5ea3-43de-a6db-01dac586a63d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3099244 Sep 16 16:23:50.581603 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b09187-588d-43f6-8924-03244601397e req-8f2ae04c-5067-45b6-80bf-c9af5f4716a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:50.583347 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-8f2ae04c-5067-45b6-80bf-c9af5f4716a9 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.3938868 Sep 16 16:23:50.629124 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ec469fde-4f83-4483-88eb-713a7a06f69c {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:50.637900 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.652918 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1c850898-2d96-4d46-809f-22cbac12e6a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.653837 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Transition to ACTIVE for port object ec469fde-4f83-4483-88eb-713a7a06f69c will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:23:50.656772 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1c850898-2d96-4d46-809f-22cbac12e6a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.658028 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1c850898-2d96-4d46-809f-22cbac12e6a4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/5c3d822d-5208-45e0-86ae-9cad2ce86d48 HTTP/1.1" status: 204 len: 168 time: 0.6097970 Sep 16 16:23:50.660177 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.661613 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-a6e88a4c-d18a-4288-97c0-3544a2bb7641 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 217 time: 0.0541275 Sep 16 16:23:50.670063 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c850898-2d96-4d46-809f-22cbac12e6a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c3d822d-5208-45e0-86ae-9cad2ce86d48,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:50.729514 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b09187-588d-43f6-8924-03244601397e req-fc1f1c61-24c2-481e-ac12-7536a917e889 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:50.731501 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-fc1f1c61-24c2-481e-ac12-7536a917e889 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0512519 Sep 16 16:23:50.744383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Pushing event updated for resources: {'Port': ['ID=ec469fde-4f83-4483-88eb-713a7a06f69c,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:50.764681 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-34ea1daa-9190-4d90-ad64-ef1632ecb54d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.806370 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-b4ce781d-8123-4064-9939-98e429ceffe1 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0652046 Sep 16 16:23:50.842806 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Attempting to bind port ec469fde-4f83-4483-88eb-713a7a06f69c on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:23:50.843272 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Attempting to bind port ec469fde-4f83-4483-88eb-713a7a06f69c by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:23:50.843676 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Attempting to bind port ec469fde-4f83-4483-88eb-713a7a06f69c on network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:50.848468 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Port ec469fde-4f83-4483-88eb-713a7a06f69c on network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:23:50.848857 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Attempting to bind port ec469fde-4f83-4483-88eb-713a7a06f69c on network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:23:50.855643 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 23, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:23:50.856178 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Checking segment: {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:23:50.856356 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Bound using segment: {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:23:50.856782 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Bound port: ec469fde-4f83-4483-88eb-713a7a06f69c, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:23:50.857144 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:50.936500 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-0b5dc9d1-7680-4e15-bcb2-6e1706e91cba service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1148963 Sep 16 16:23:50.948684 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] For port ec469fde-4f83-4483-88eb-713a7a06f69c, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:23:50.952993 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] For port ec469fde-4f83-4483-88eb-713a7a06f69c, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec469fde-4f83-4483-88eb-713a7a06f69c,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:23:50.963316 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:51.024689 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Pushing event updated for resources: {'Port': ['ID=ec469fde-4f83-4483-88eb-713a7a06f69c,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:51.069575 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:51.070195 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:51.071844 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-651dc929-588e-45fb-b0be-ccd1fee0203b service neutron] 10.222.0.66 "PUT /v2.0/ports/ec469fde-4f83-4483-88eb-713a7a06f69c HTTP/1.1" status: 200 len: 1093 time: 1.0419776 Sep 16 16:23:51.073623 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea757037-096c-4400-8ff3-7169214e3175', 'tag': 'ec469fde-4f83-4483-88eb-713a7a06f69c'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:51.074457 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-204aa44d-f093-4fbf-ab22-3719bc5d39b4" -d '{"events": [{"name": "network-changed", "server_uuid": "ea757037-096c-4400-8ff3-7169214e3175", "tag": "ec469fde-4f83-4483-88eb-713a7a06f69c"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:51.156129 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-62b09187-588d-43f6-8924-03244601397e req-56028b0c-bc03-4560-919b-a8e790286621 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1956470 Sep 16 16:23:51.161058 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e7e47b2-7374-422b-a762-9f4c447c4af9 x-openstack-request-id: req-8e7e47b2-7374-422b-a762-9f4c447c4af9 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:51.161348 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea757037-096c-4400-8ff3-7169214e3175", "tag": "ec469fde-4f83-4483-88eb-713a7a06f69c", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:51.161594 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-8e7e47b2-7374-422b-a762-9f4c447c4af9 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:51.162106 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea757037-096c-4400-8ff3-7169214e3175', 'tag': 'ec469fde-4f83-4483-88eb-713a7a06f69c', 'status': 'completed', 'code': 200} Sep 16 16:23:51.215102 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-b3fad186-89c5-46d2-a712-4b9a2b24a708 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:51.220553 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-b3fad186-89c5-46d2-a712-4b9a2b24a708 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=f5178fe3547b432792996a0b47d8a025&device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 1096 time: 0.0707664 Sep 16 16:23:51.300526 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-4c2edffd-e803-4eee-8c70-3f62cc4a6a77 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ec469fde-4f83-4483-88eb-713a7a06f69c HTTP/1.1" status: 200 len: 217 time: 0.0681171 Sep 16 16:23:51.385938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506b66f5-86e2-4047-a5cc-fe1e7a9dcd2b req-22ea2d2f-2f64-4049-a2f3-116f5c9fe3e5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:51.393412 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-506b66f5-86e2-4047-a5cc-fe1e7a9dcd2b req-22ea2d2f-2f64-4049-a2f3-116f5c9fe3e5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 943 time: 0.0955498 Sep 16 16:23:51.426910 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-ea4398c6-77d2-4c8c-bc0b-4bcf7328cbcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:51.428898 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-ea4398c6-77d2-4c8c-bc0b-4bcf7328cbcc service neutron] 10.222.0.66 "GET /v2.0/subnets?id=a059b6f3-51b1-44ce-96d4-f56363397303 HTTP/1.1" status: 200 len: 849 time: 0.0983975 Sep 16 16:23:51.465986 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-506b66f5-86e2-4047-a5cc-fe1e7a9dcd2b req-5fd66929-b4d6-45d1-a275-612b9b4dbbb0 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713277 Sep 16 16:23:51.492400 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-8981ffe5-b7ea-44f4-9851-cfc37a75f6b6 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=6552c4e5-d945-44f2-a079-8db3b3dd41c5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0507410 Sep 16 16:23:51.688924 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe2890f-cbe1-4a68-a814-d9b161282509 req-893da522-b443-497b-9ff5-4543e0492c32 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:51.694082 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-dbb63085-9a6a-4a12-9fbe-7232d9e4df06 service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1899652 Sep 16 16:23:51.696345 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4fe2890f-cbe1-4a68-a814-d9b161282509 req-893da522-b443-497b-9ff5-4543e0492c32 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 945 time: 0.0950270 Sep 16 16:23:51.745686 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4fe2890f-cbe1-4a68-a814-d9b161282509 req-055233a9-224d-42a0-ba18-b551670d48b8 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429170 Sep 16 16:23:51.837786 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f874a79-207c-4bb2-b345-a04463be9822 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:23:51.853132 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d12595f-ec34-4223-a955-ef38dc8dd409 req-3cd90fe9-f0ab-46c9-8308-2870975fc27f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:51.854736 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5d12595f-ec34-4223-a955-ef38dc8dd409 req-3cd90fe9-f0ab-46c9-8308-2870975fc27f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1263828 Sep 16 16:23:51.884247 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa623373-066d-4dae-b7a6-396bbfcc25aa req-59d663d1-a6a0-4478-95a6-7a5ec9c8e925 service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1727700 Sep 16 16:23:51.904149 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port 2f874a79-207c-4bb2-b345-a04463be9822 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:23:51.911298 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port 2f874a79-207c-4bb2-b345-a04463be9822 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:23:51.912473 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:51.934306 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5d12595f-ec34-4223-a955-ef38dc8dd409 req-ca7691af-758a-41f3-94bc-b32b7520ea31 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673890 Sep 16 16:23:52.007979 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-892d9572-1973-46fc-b47b-311cac6d0a15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:52.010350 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-892d9572-1973-46fc-b47b-311cac6d0a15 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=f5178fe3547b432792996a0b47d8a025&device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 1096 time: 0.0539622 Sep 16 16:23:52.029187 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:52.061847 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f874a79-207c-4bb2-b345-a04463be9822'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:23:52.064274 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa7d8ebe-0740-4a91-bd5e-fdd1d97d14cc" -d '{"events": [{"server_uuid": "af27223f-6b95-4186-88b6-dc57e7f510b7", "name": "network-vif-plugged", "status": "completed", "tag": "2f874a79-207c-4bb2-b345-a04463be9822"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:23:52.079556 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 2f874a79-207c-4bb2-b345-a04463be9822, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f874a79-207c-4bb2-b345-a04463be9822,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:52.088643 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:52.134844 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-48434968-941d-458a-ab4e-1d953b334d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:52.136598 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-48434968-941d-458a-ab4e-1d953b334d6a service neutron] 10.222.0.66 "GET /v2.0/networks?id=6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 200 len: 910 time: 0.1131337 Sep 16 16:23:52.139167 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:23:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c30292fb-43a7-4b2d-bc77-e7347691d688 x-openstack-request-id: req-c30292fb-43a7-4b2d-bc77-e7347691d688 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:23:52.139489 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af27223f-6b95-4186-88b6-dc57e7f510b7", "name": "network-vif-plugged", "status": "completed", "tag": "2f874a79-207c-4bb2-b345-a04463be9822", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:23:52.139764 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-c30292fb-43a7-4b2d-bc77-e7347691d688 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:23:52.140139 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f874a79-207c-4bb2-b345-a04463be9822', 'code': 200} Sep 16 16:23:52.183534 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=2f874a79-207c-4bb2-b345-a04463be9822,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:52.206980 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-2f868de5-59f9-422a-82cb-8e575edbb0f1 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ec469fde-4f83-4483-88eb-713a7a06f69c HTTP/1.1" status: 200 len: 217 time: 0.0494723 Sep 16 16:23:52.274859 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-099e6da9-e15d-44df-8bb3-9d8dab79850e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:52.276335 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-099e6da9-e15d-44df-8bb3-9d8dab79850e service neutron] 10.222.0.66 "GET /v2.0/subnets?id=a059b6f3-51b1-44ce-96d4-f56363397303 HTTP/1.1" status: 200 len: 849 time: 0.0562749 Sep 16 16:23:52.325701 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-f5416ff1-3c8d-415a-8042-f9028e96a054 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=6552c4e5-d945-44f2-a079-8db3b3dd41c5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0288978 Sep 16 16:23:52.372948 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f3b554-d761-4d73-97d8-68ac0bc4bfa6 req-f7055496-5592-4772-a045-dc1a674d8b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:52.374728 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-05f3b554-d761-4d73-97d8-68ac0bc4bfa6 req-f7055496-5592-4772-a045-dc1a674d8b96 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 1099 time: 0.0550292 Sep 16 16:23:52.431688 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-05f3b554-d761-4d73-97d8-68ac0bc4bfa6 req-07ca192e-29e5-4454-8a35-02b9f1ea984c service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446491 Sep 16 16:23:52.453486 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-cb345c2a-82d1-4f84-8e37-0375f954558b service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193321 Sep 16 16:23:52.656814 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9bae81-5d94-4305-8b86-41e470108c14 req-57032bc6-bf5a-4b8b-82e4-b2730ec7fe61 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:52.658528 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ab9bae81-5d94-4305-8b86-41e470108c14 req-57032bc6-bf5a-4b8b-82e4-b2730ec7fe61 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 943 time: 0.0846639 Sep 16 16:23:52.704152 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ab9bae81-5d94-4305-8b86-41e470108c14 req-b183135b-ef6d-406a-8744-5c331bbbf075 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386028 Sep 16 16:23:52.795345 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-204aa44d-f093-4fbf-ab22-3719bc5d39b4 req-40ac8753-2dbb-4cc6-b0ed-16bb6ce3a229 service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1285892 Sep 16 16:23:52.900060 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d67eed15-5d41-406b-80dd-a28bbc42e7c7 req-73767961-9794-4ec2-b45d-eb8c038708be tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:52.901589 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d67eed15-5d41-406b-80dd-a28bbc42e7c7 req-73767961-9794-4ec2-b45d-eb8c038708be tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0691140 Sep 16 16:23:52.979882 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d67eed15-5d41-406b-80dd-a28bbc42e7c7 req-f7beca52-a2e4-4f53-9f9e-4ad9cf991744 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642965 Sep 16 16:23:53.118165 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d44a13-4582-41c2-955c-e2c9abea4485 req-c6286005-4c95-478c-a3f3-6b4b35466597 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:53.129724 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-17d44a13-4582-41c2-955c-e2c9abea4485 req-c6286005-4c95-478c-a3f3-6b4b35466597 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0737095 Sep 16 16:23:53.167309 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-17d44a13-4582-41c2-955c-e2c9abea4485 req-458d284a-109a-45c3-93c1-0e75ec099d8f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367033 Sep 16 16:23:53.438243 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-073a57c5-1d98-4464-9a31-58d9185b2006 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:53.714277 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:53.857193 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7709d0a7-13ea-46ee-bc67-83371de61742 req-04915689-a1c1-4322-b6dd-cf7d73d8c270 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:53.858668 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7709d0a7-13ea-46ee-bc67-83371de61742 req-04915689-a1c1-4322-b6dd-cf7d73d8c270 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 943 time: 0.0614858 Sep 16 16:23:53.872394 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec469fde-4f83-4483-88eb-713a7a06f69c details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:23:53.918610 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7709d0a7-13ea-46ee-bc67-83371de61742 req-53e7d472-4f48-4bbb-9236-27bf384f1ab3 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439780 Sep 16 16:23:53.970169 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ec469fde-4f83-4483-88eb-713a7a06f69c, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec469fde-4f83-4483-88eb-713a7a06f69c,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:54.100445 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'ec469fde-4f83-4483-88eb-713a7a06f69c', 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5', 'port_id': 'ec469fde-4f83-4483-88eb-713a7a06f69c', 'mac_address': 'fa:16:3e:b8:54:9f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 738, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a059b6f3-51b1-44ce-96d4-f56363397303', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:23:54.139501 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd58809e-66b7-4d69-8c2f-82e145b6d76c req-99309bf6-3194-4b2c-a988-197fbf97f6ac tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:54.145480 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-dd58809e-66b7-4d69-8c2f-82e145b6d76c req-99309bf6-3194-4b2c-a988-197fbf97f6ac tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0922577 Sep 16 16:23:54.152593 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:54.167604 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec469fde-4f83-4483-88eb-713a7a06f69c {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:23:54.191187 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ec469fde-4f83-4483-88eb-713a7a06f69c, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec469fde-4f83-4483-88eb-713a7a06f69c,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:23:54.192142 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-dd58809e-66b7-4d69-8c2f-82e145b6d76c req-fc6adfb0-46a9-4cf7-9884-662d4a4c9db0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391939 Sep 16 16:23:54.196082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:54.254855 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=ec469fde-4f83-4483-88eb-713a7a06f69c,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:54.308847 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-818cdcb5-af44-4b17-afec-dd789ecba8ce req-95a71deb-c2e5-4f4f-9b4a-cfff1cb19377 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:54.310662 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-818cdcb5-af44-4b17-afec-dd789ecba8ce req-95a71deb-c2e5-4f4f-9b4a-cfff1cb19377 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0540442 Sep 16 16:23:54.354920 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:54.375519 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-818cdcb5-af44-4b17-afec-dd789ecba8ce req-049f0fee-34d5-4625-be89-f11924c32a39 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563393 Sep 16 16:23:55.042971 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b5199a-b6fe-49f5-adb8-bed0a13d5742 req-49c2c957-6d92-4304-afe2-b617e671718b tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:55.044512 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-31b5199a-b6fe-49f5-adb8-bed0a13d5742 req-49c2c957-6d92-4304-afe2-b617e671718b tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 944 time: 0.0476427 Sep 16 16:23:55.077946 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39124) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:55.087140 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-31b5199a-b6fe-49f5-adb8-bed0a13d5742 req-6447b496-d5ee-4d82-8372-57935fbe8975 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366850 Sep 16 16:23:55.208037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-d3a3ddba-7ade-4508-a415-17af06d3cf51 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=96c75cd13f92458bae1e2ed82f3a73bb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1266880 Sep 16 16:23:55.208553 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39128) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:23:55.256168 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-abbb2739-8b90-48f3-bf09-f04e30d424b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:55.279992 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-abbb2739-8b90-48f3-bf09-f04e30d424b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:55.309430 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c951af5-5238-4331-a61a-cabe06ef6e1d req-3b90e649-6aa5-498b-b578-bccf32ac9fec tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:55.310917 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1c951af5-5238-4331-a61a-cabe06ef6e1d req-3b90e649-6aa5-498b-b578-bccf32ac9fec tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0469244 Sep 16 16:23:55.329469 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-abbb2739-8b90-48f3-bf09-f04e30d424b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:55.332118 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-abbb2739-8b90-48f3-bf09-f04e30d424b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:55.333370 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-abbb2739-8b90-48f3-bf09-f04e30d424b7 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c203e23d-8ac4-4859-8784-da907f90655b HTTP/1.1" status: 204 len: 168 time: 0.1242187 Sep 16 16:23:55.341336 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbb2739-8b90-48f3-bf09-f04e30d424b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c203e23d-8ac4-4859-8784-da907f90655b,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:23:55.356353 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1c951af5-5238-4331-a61a-cabe06ef6e1d req-034a89f4-2f29-4cbb-9403-dfdc0965c741 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392168 Sep 16 16:23:56.170256 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:23:56.198912 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3a4bbb-1e2d-415b-a922-ddc561fc31ae req-51bb7243-3c0b-41c2-9dd9-18e5359d4ec2 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:56.200426 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4b3a4bbb-1e2d-415b-a922-ddc561fc31ae req-51bb7243-3c0b-41c2-9dd9-18e5359d4ec2 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 944 time: 0.0489311 Sep 16 16:23:56.237348 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4b3a4bbb-1e2d-415b-a922-ddc561fc31ae req-bbe84d07-048c-41fa-b628-ff7ba6e0937e tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310125 Sep 16 16:23:57.353068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd20be2-9106-4a67-b1f9-c0b6af78eea8 req-03548c29-c187-4ba4-9058-d6262292636c tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:57.354574 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7dd20be2-9106-4a67-b1f9-c0b6af78eea8 req-03548c29-c187-4ba4-9058-d6262292636c tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 944 time: 0.0511575 Sep 16 16:23:57.399663 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7dd20be2-9106-4a67-b1f9-c0b6af78eea8 req-ce441f1c-fb62-408a-b8d9-859febc6af07 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368807 Sep 16 16:23:57.609370 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['ec469fde-4f83-4483-88eb-713a7a06f69c'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:23:58.538415 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b867057-f3d2-4ed8-abbf-c662bb5fd235 req-d83394b5-4ce8-43fb-a38e-710b37cd54bc tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:58.541912 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7b867057-f3d2-4ed8-abbf-c662bb5fd235 req-d83394b5-4ce8-43fb-a38e-710b37cd54bc tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 944 time: 0.0585933 Sep 16 16:23:58.582840 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7b867057-f3d2-4ed8-abbf-c662bb5fd235 req-c6341e6f-3cd0-48c4-a624-029bc3355202 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350158 Sep 16 16:23:58.986845 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-7d2ac975-4e8c-4be2-99e1-2afb0b0a39c3 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:58.988401 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-7d2ac975-4e8c-4be2-99e1-2afb0b0a39c3 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.1055658 Sep 16 16:23:59.005345 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2fd10929-188d-454f-8265-4ba9f967808f tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/quotas/0378b53234de487d8ebc6eeb3fbfbe5d HTTP/1.1" status: 200 len: 375 time: 0.0107086 Sep 16 16:23:59.060734 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-31f22eba-ec6a-4f31-834d-ab9471fcfa56 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0484619 Sep 16 16:23:59.106426 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7a8863-84a8-4f7f-b81b-13dd8c06f7a7 req-9622c8b6-aa52-4141-8e09-fa92908b9784 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:59.107923 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9a7a8863-84a8-4f7f-b81b-13dd8c06f7a7 req-9622c8b6-aa52-4141-8e09-fa92908b9784 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0547593 Sep 16 16:23:59.148749 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9a7a8863-84a8-4f7f-b81b-13dd8c06f7a7 req-06963b73-fcda-4bed-a701-6b1603aff803 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342400 Sep 16 16:23:59.168906 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-ba07bd32-d73a-4377-9106-30d6817279d1 service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1006911 Sep 16 16:23:59.279608 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-237f6ecd-1a54-40b3-9571-06d41e9dc109 service neutron] 10.222.0.59 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1044402 Sep 16 16:23:59.450314 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b04de5ab-5804-42d0-9aca-b1e28ed93978 req-63b1d7de-6609-4aca-a80e-b2b299e0baf7 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 210 time: 0.0305221 Sep 16 16:23:59.709651 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec6de7-3db3-42c4-bf94-57dbd13076c6 req-2d1ee201-0e84-4c82-aaf5-4cc5137220b7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:23:59.711164 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-caec6de7-3db3-42c4-bf94-57dbd13076c6 req-2d1ee201-0e84-4c82-aaf5-4cc5137220b7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 944 time: 0.0494113 Sep 16 16:23:59.748876 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-caec6de7-3db3-42c4-bf94-57dbd13076c6 req-a809d4a7-a676-447f-af1a-d5b412a7c105 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316708 Sep 16 16:23:59.885787 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec469fde-4f83-4483-88eb-713a7a06f69c up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:23:59.936531 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port ec469fde-4f83-4483-88eb-713a7a06f69c completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:23:59.940530 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port ec469fde-4f83-4483-88eb-713a7a06f69c triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:23:59.941158 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.029254 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.053960 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea757037-096c-4400-8ff3-7169214e3175', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec469fde-4f83-4483-88eb-713a7a06f69c'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:00.056660 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0ecd672-ee2b-498e-9482-7397c2e4a927" -d '{"events": [{"server_uuid": "ea757037-096c-4400-8ff3-7169214e3175", "name": "network-vif-plugged", "status": "completed", "tag": "ec469fde-4f83-4483-88eb-713a7a06f69c"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:00.084390 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ec469fde-4f83-4483-88eb-713a7a06f69c, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec469fde-4f83-4483-88eb-713a7a06f69c,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:00.091714 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.118178 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89838c2e-e0ef-4b74-a72d-bbcefa86193e x-openstack-request-id: req-89838c2e-e0ef-4b74-a72d-bbcefa86193e {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:00.118464 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea757037-096c-4400-8ff3-7169214e3175", "name": "network-vif-plugged", "status": "completed", "tag": "ec469fde-4f83-4483-88eb-713a7a06f69c", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:00.118868 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-89838c2e-e0ef-4b74-a72d-bbcefa86193e {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:00.119284 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea757037-096c-4400-8ff3-7169214e3175', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec469fde-4f83-4483-88eb-713a7a06f69c', 'code': 200} Sep 16 16:24:00.146545 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=ec469fde-4f83-4483-88eb-713a7a06f69c,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:00.310688 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b17a750-0d54-422d-93df-c43436f5e4a2 req-3177bd4b-c61c-4c24-bd0b-88994dabc47d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:00.312210 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6b17a750-0d54-422d-93df-c43436f5e4a2 req-3177bd4b-c61c-4c24-bd0b-88994dabc47d service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 1098 time: 0.0399227 Sep 16 16:24:00.346975 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6b17a750-0d54-422d-93df-c43436f5e4a2 req-f1e1a9a0-7e8e-48fb-8db0-704e68f3367d service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0265148 Sep 16 16:24:00.532212 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39314) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:00.556475 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-98e666a1-a500-4c97-860b-4d8f36428ec1 req-28551f37-b344-4064-9768-6b3761e8dbd5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 210 time: 0.0341370 Sep 16 16:24:00.654495 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e23e28cf-2238-429c-8311-bad00a67470f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.754098 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e23e28cf-2238-429c-8311-bad00a67470f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.757957 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e23e28cf-2238-429c-8311-bad00a67470f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.796916 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e23e28cf-2238-429c-8311-bad00a67470f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=9b808e45dbab4dac944688dd675cdd6e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2637243 Sep 16 16:24:00.803877 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39324) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:00.818827 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23e28cf-2238-429c-8311-bad00a67470f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b755846-aefc-4dfc-9d7c-1810a224496a,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:00.899178 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0295d715-70dc-46bb-a8c0-3e92a7700374 req-e89305b3-f0c8-4758-89c0-f863ef87e088 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:00.900686 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0295d715-70dc-46bb-a8c0-3e92a7700374 req-e89305b3-f0c8-4758-89c0-f863ef87e088 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 945 time: 0.0735538 Sep 16 16:24:00.931260 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-243683cf-0a44-48ce-ab42-ae7ed6315eae tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:00.932225 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-646952a8-5f53-4657-a6cd-6734bb21aefe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:00.932713 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-243683cf-0a44-48ce-ab42-ae7ed6315eae tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 815 time: 0.1120853 Sep 16 16:24:00.953948 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Request body: {'port': {'device_id': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'admin_state_up': True, 'tenant_id': '0378b53234de487d8ebc6eeb3fbfbe5d'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:00.959636 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0295d715-70dc-46bb-a8c0-3e92a7700374 req-8a4d8e4b-dc6e-43b2-822e-8f8cd33adc37 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513964 Sep 16 16:24:00.971034 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-646952a8-5f53-4657-a6cd-6734bb21aefe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.026441 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-646952a8-5f53-4657-a6cd-6734bb21aefe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.029580 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-646952a8-5f53-4657-a6cd-6734bb21aefe admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.030878 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-646952a8-5f53-4657-a6cd-6734bb21aefe admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7b755846-aefc-4dfc-9d7c-1810a224496a HTTP/1.1" status: 204 len: 168 time: 0.2186565 Sep 16 16:24:01.042088 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646952a8-5f53-4657-a6cd-6734bb21aefe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b755846-aefc-4dfc-9d7c-1810a224496a,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:01.076981 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Made reservation on behalf of 0378b53234de487d8ebc6eeb3fbfbe5d for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:24:01.081155 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.232769 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Allocated IP 172.20.0.9 (143ad357-dcc1-47a6-a228-62d36164e62c/57a636e1-0951-4c2f-8be2-8ca36acb1d05/c4a23598-f189-46c2-8418-2a4bc652cd85) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:01.399832 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.435194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.453484 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'e62f01f3-63a1-4192-9c47-7358f178184b'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:01.483556 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Network 143ad357-dcc1-47a6-a228-62d36164e62c is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:01.487410 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:01.492300 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:01.535853 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event updated for resources: {'Port': ['ID=c4a23598-f189-46c2-8418-2a4bc652cd85,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:01.552494 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:01.553133 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.566859 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-3c697a18-cd16-44ce-96ad-2b22134e38e8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6173172 Sep 16 16:24:01.597166 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Request body: {'port': {'device_id': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:01.692631 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:01.717400 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b335a33b-f0db-4dbf-9489-8bae9f460f76 req-33bae659-ea3d-4f89-b550-46c390411487 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:01.718883 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b335a33b-f0db-4dbf-9489-8bae9f460f76 req-33bae659-ea3d-4f89-b550-46c390411487 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 931 time: 0.0818448 Sep 16 16:24:01.834983 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b335a33b-f0db-4dbf-9489-8bae9f460f76 req-9e302e83-3a32-4614-a04c-c46554af0433 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965662 Sep 16 16:24:01.995887 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c4a23598-f189-46c2-8418-2a4bc652cd85 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:24:02.003483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:02.017015 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Transition to ACTIVE for port object c4a23598-f189-46c2-8418-2a4bc652cd85 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:24:02.020746 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:02.067496 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Pushing event updated for resources: {'Port': ['ID=c4a23598-f189-46c2-8418-2a4bc652cd85,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:02.093047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b27b8cf-8476-41f3-9b2e-2b7f2738c420 req-24484d9a-535f-4f00-a0d3-7701fd07c1e4 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:02.094544 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7b27b8cf-8476-41f3-9b2e-2b7f2738c420 req-24484d9a-535f-4f00-a0d3-7701fd07c1e4 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 945 time: 0.0511882 Sep 16 16:24:02.131359 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7b27b8cf-8476-41f3-9b2e-2b7f2738c420 req-84406df6-1796-49a6-b7b7-4f134e48b6cf tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307810 Sep 16 16:24:02.135457 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Attempting to bind port c4a23598-f189-46c2-8418-2a4bc652cd85 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:02.135791 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Attempting to bind port c4a23598-f189-46c2-8418-2a4bc652cd85 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:02.136116 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Attempting to bind port c4a23598-f189-46c2-8418-2a4bc652cd85 on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:02.140374 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Port c4a23598-f189-46c2-8418-2a4bc652cd85 on network 143ad357-dcc1-47a6-a228-62d36164e62c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:24:02.140687 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Attempting to bind port c4a23598-f189-46c2-8418-2a4bc652cd85 on network 143ad357-dcc1-47a6-a228-62d36164e62c {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:02.145603 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 23, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:02.145938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Checking segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:02.146326 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Bound using segment: {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:02.146731 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Bound port: c4a23598-f189-46c2-8418-2a4bc652cd85, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '527820c5-a337-4239-b438-0c52b8d78dde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 703, 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:02.147083 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:02.221924 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] For port c4a23598-f189-46c2-8418-2a4bc652cd85, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:02.224989 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] For port c4a23598-f189-46c2-8418-2a4bc652cd85, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=c4a23598-f189-46c2-8418-2a4bc652cd85,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:02.229557 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:02.261622 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:02.262572 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:02.263991 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] 10.222.0.66 "PUT /v2.0/ports/c4a23598-f189-46c2-8418-2a4bc652cd85 HTTP/1.1" status: 200 len: 1093 time: 0.6720412 Sep 16 16:24:02.266167 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'tag': 'c4a23598-f189-46c2-8418-2a4bc652cd85'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:02.268458 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00557d5c-5449-43b9-bef0-0919d2620547" -d '{"events": [{"name": "network-changed", "server_uuid": "273adae0-6efc-4507-aa4d-869e04dc3e9f", "tag": "c4a23598-f189-46c2-8418-2a4bc652cd85"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:02.299142 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb34bfc-7c1a-4fdb-99bf-3776d523b762 service neutron] Pushing event updated for resources: {'Port': ['ID=c4a23598-f189-46c2-8418-2a4bc652cd85,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:02.314135 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0a59122-7c45-4faf-814d-670bd0094575 x-openstack-request-id: req-e0a59122-7c45-4faf-814d-670bd0094575 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:02.314419 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "273adae0-6efc-4507-aa4d-869e04dc3e9f", "tag": "c4a23598-f189-46c2-8418-2a4bc652cd85", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:02.314663 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-e0a59122-7c45-4faf-814d-670bd0094575 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:02.315045 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'tag': 'c4a23598-f189-46c2-8418-2a4bc652cd85', 'status': 'completed', 'code': 200} Sep 16 16:24:02.361544 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-15b340b5-5cd9-44c3-9a21-cf73d9421c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:02.363094 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-15b340b5-5cd9-44c3-9a21-cf73d9421c4e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 1096 time: 0.0398314 Sep 16 16:24:02.408961 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-b9d8075c-f00d-4996-bc9d-4ff6b9e82eb2 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4a23598-f189-46c2-8418-2a4bc652cd85 HTTP/1.1" status: 200 len: 217 time: 0.0355835 Sep 16 16:24:02.463494 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-d89c819f-425e-4f95-a3d6-9de2e55c8fe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:02.464955 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-d89c819f-425e-4f95-a3d6-9de2e55c8fe6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.0437908 Sep 16 16:24:02.503128 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-7a6326c8-a005-4c61-ac9d-fff2d7b3cca5 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242374 Sep 16 16:24:02.601573 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-8d99e72d-5f92-414a-8c53-b6b006c5d914 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864792 Sep 16 16:24:02.952904 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-124c2821-42f3-42ac-9b39-5276f852bc72 req-b509a470-98ae-4dbc-87a8-b8f51a4fe355 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3430531 Sep 16 16:24:03.021227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02138159-16be-4600-bffe-5220a138c4e0 req-48486a4e-3b0a-4a23-9b99-91ceaf5aabf6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:03.022632 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-02138159-16be-4600-bffe-5220a138c4e0 req-48486a4e-3b0a-4a23-9b99-91ceaf5aabf6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 943 time: 0.0517695 Sep 16 16:24:03.069616 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-02138159-16be-4600-bffe-5220a138c4e0 req-918cfd8d-925a-42a8-914f-bba7b1a80258 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408878 Sep 16 16:24:03.094932 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00557d5c-5449-43b9-bef0-0919d2620547 req-e9ac9c46-ad66-4164-899c-0380e09aeabb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:03.096451 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-e9ac9c46-ad66-4164-899c-0380e09aeabb service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 1096 time: 0.0429165 Sep 16 16:24:03.198113 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcef9f53-bc58-4b24-a129-1f921af3497c req-c259458d-da6a-4bc6-98b5-45182c874cc5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:03.199629 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dcef9f53-bc58-4b24-a129-1f921af3497c req-c259458d-da6a-4bc6-98b5-45182c874cc5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 945 time: 0.1111009 Sep 16 16:24:03.235705 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00557d5c-5449-43b9-bef0-0919d2620547 req-be913da8-a8aa-4f93-a8e1-bd239e556bb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:03.237090 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-be913da8-a8aa-4f93-a8e1-bd239e556bb8 service neutron] 10.222.0.66 "GET /v2.0/networks?id=143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 200 len: 916 time: 0.1138651 Sep 16 16:24:03.264583 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dcef9f53-bc58-4b24-a129-1f921af3497c req-56cd860e-b281-4915-ac6f-b10280c81832 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573597 Sep 16 16:24:03.293827 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-196a3994-9b1d-4e72-befd-c1f027e16a20 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4a23598-f189-46c2-8418-2a4bc652cd85 HTTP/1.1" status: 200 len: 217 time: 0.0417998 Sep 16 16:24:03.345586 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00557d5c-5449-43b9-bef0-0919d2620547 req-32473d1b-3564-49c3-ae47-a6bfd926f16a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:03.346966 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-32473d1b-3564-49c3-ae47-a6bfd926f16a service neutron] 10.222.0.66 "GET /v2.0/subnets?id=57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 200 len: 855 time: 0.0414560 Sep 16 16:24:03.382030 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-a168238d-2327-4722-bc0f-c97584794394 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=143ad357-dcc1-47a6-a228-62d36164e62c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0231438 Sep 16 16:24:03.484047 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-b5f9d9d2-433e-4dfb-8c04-fcc4fa96a115 service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837781 Sep 16 16:24:03.574320 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00557d5c-5449-43b9-bef0-0919d2620547 req-819e3f82-a45a-42ad-8f84-0c8a430b7f9d service neutron] 10.222.0.66 "GET /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0783296 Sep 16 16:24:04.195896 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda8b693-a7e4-4562-a7bd-409c9c664801 req-e81bb2cd-635a-403b-b1fd-35f990e6d5a0 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:04.197429 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cda8b693-a7e4-4562-a7bd-409c9c664801 req-e81bb2cd-635a-403b-b1fd-35f990e6d5a0 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 943 time: 0.0550890 Sep 16 16:24:04.237521 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cda8b693-a7e4-4562-a7bd-409c9c664801 req-6e6690d2-183c-48b8-b167-1785cba23cc9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341911 Sep 16 16:24:04.384712 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db7eb47-97f8-4fd0-8a8e-d614642d9b2b req-769e93c0-35d8-4d3b-ade3-1af62a10b7aa tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:04.386406 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7db7eb47-97f8-4fd0-8a8e-d614642d9b2b req-769e93c0-35d8-4d3b-ade3-1af62a10b7aa tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 945 time: 0.0542319 Sep 16 16:24:04.425086 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7db7eb47-97f8-4fd0-8a8e-d614642d9b2b req-5615b17a-bfac-4beb-b37f-0766c13976c4 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315824 Sep 16 16:24:05.246912 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-f7c5f82d-883c-4b36-8c3b-f329bd36a8c2 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:05.248375 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-f7c5f82d-883c-4b36-8c3b-f329bd36a8c2 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 945 time: 0.0490384 Sep 16 16:24:05.427845 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae07e29f-2f96-4fce-a97f-4c8b3583b770 req-1fa052e9-722b-4abf-87dd-94c98d5d31a9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:05.429914 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ae07e29f-2f96-4fce-a97f-4c8b3583b770 req-1fa052e9-722b-4abf-87dd-94c98d5d31a9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 943 time: 0.1053889 Sep 16 16:24:05.460994 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Deleting port ec469fde-4f83-4483-88eb-713a7a06f69c {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:24:05.461229 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:05.531517 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ae07e29f-2f96-4fce-a97f-4c8b3583b770 req-ae86e2a6-3ba7-4095-b6c6-02fecededdbd tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951171 Sep 16 16:24:05.552604 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964f18da-bdd9-48be-9ed2-334ca34681d7 req-90eb2f2b-3bd5-4b3b-803f-4d2428a039cd tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:05.555692 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-964f18da-bdd9-48be-9ed2-334ca34681d7 req-90eb2f2b-3bd5-4b3b-803f-4d2428a039cd tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=ea757037-096c-4400-8ff3-7169214e3175 HTTP/1.1" status: 200 len: 945 time: 0.0561903 Sep 16 16:24:05.579391 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] For port ec469fde-4f83-4483-88eb-713a7a06f69c, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec469fde-4f83-4483-88eb-713a7a06f69c,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:05.579760 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:05.598073 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Calling delete_port for ec469fde-4f83-4483-88eb-713a7a06f69c owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:24:05.611449 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-964f18da-bdd9-48be-9ed2-334ca34681d7 req-8a7226f3-e7e8-42b4-a8a8-da5982ac73b1 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500786 Sep 16 16:24:05.790772 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:05.804963 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['ec469fde-4f83-4483-88eb-713a7a06f69c'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:05.836335 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Pushing event deleted for resources: {'Port': ['ID=ec469fde-4f83-4483-88eb-713a7a06f69c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:05.888375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.888375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.888375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.888375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.888375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.888764 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.888984 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.889186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.889490 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.889798 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.890109 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.890414 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:05.909640 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device c4a23598-f189-46c2-8418-2a4bc652cd85 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:24:05.922115 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] No DVR routers for this DVR port ec469fde-4f83-4483-88eb-713a7a06f69c on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:24:05.929156 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:05.935389 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a31b5ef3-4c1e-4423-9f38-57eb59a5ef8d req-0cba67ef-e88f-4883-807a-cd9fe4feef17 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "DELETE /v2.0/ports/ec469fde-4f83-4483-88eb-713a7a06f69c HTTP/1.1" status: 204 len: 173 time: 0.6518884 Sep 16 16:24:05.936175 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea757037-096c-4400-8ff3-7169214e3175', 'name': 'network-vif-deleted', 'tag': 'ec469fde-4f83-4483-88eb-713a7a06f69c'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:05.948559 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7e8460e-5b10-4873-b3e2-b307b11a47ff" -d '{"events": [{"server_uuid": "ea757037-096c-4400-8ff3-7169214e3175", "name": "network-vif-deleted", "tag": "ec469fde-4f83-4483-88eb-713a7a06f69c"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:05.999077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7390e1ae-7f83-45d3-ac3f-11000f3d4288 x-openstack-request-id: req-7390e1ae-7f83-45d3-ac3f-11000f3d4288 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:05.999605 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea757037-096c-4400-8ff3-7169214e3175", "name": "network-vif-deleted", "tag": "ec469fde-4f83-4483-88eb-713a7a06f69c", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:06.000024 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-7390e1ae-7f83-45d3-ac3f-11000f3d4288 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:06.000581 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea757037-096c-4400-8ff3-7169214e3175', 'name': 'network-vif-deleted', 'tag': 'ec469fde-4f83-4483-88eb-713a7a06f69c', 'status': 'completed', 'code': 200} Sep 16 16:24:06.033259 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port c4a23598-f189-46c2-8418-2a4bc652cd85, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=c4a23598-f189-46c2-8418-2a4bc652cd85,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:06.045596 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'c4a23598-f189-46c2-8418-2a4bc652cd85', 'network_id': '143ad357-dcc1-47a6-a228-62d36164e62c', 'port_id': 'c4a23598-f189-46c2-8418-2a4bc652cd85', 'mac_address': 'fa:16:3e:2f:9f:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 703, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '57a636e1-0951-4c2f-8be2-8ca36acb1d05', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:24:06.092715 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:06.106177 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c4a23598-f189-46c2-8418-2a4bc652cd85 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:24:06.125516 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port c4a23598-f189-46c2-8418-2a4bc652cd85, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=c4a23598-f189-46c2-8418-2a4bc652cd85,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:06.128942 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:06.173028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=c4a23598-f189-46c2-8418-2a4bc652cd85,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:06.603519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['c4a23598-f189-46c2-8418-2a4bc652cd85'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:06.662523 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7e5d38-d622-488e-ac31-9fdd1397c3bf req-17545cdb-fea0-45f4-b7f8-a4316dafd1a5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:06.664131 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ad7e5d38-d622-488e-ac31-9fdd1397c3bf req-17545cdb-fea0-45f4-b7f8-a4316dafd1a5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 944 time: 0.0612640 Sep 16 16:24:06.706458 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ad7e5d38-d622-488e-ac31-9fdd1397c3bf req-601f8836-ba5e-4d90-bd0e-f5efec8bbd9f tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356328 Sep 16 16:24:06.927584 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39476) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:06.933191 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-c603691c-c14b-47ad-9418-4ef268014da1 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:06.934577 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-c603691c-c14b-47ad-9418-4ef268014da1 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/networks?id=6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 200 len: 809 time: 0.1103323 Sep 16 16:24:06.949977 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-061c00c7-1a01-45a1-b017-c23985c7690c tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/quotas/f5178fe3547b432792996a0b47d8a025 HTTP/1.1" status: 200 len: 375 time: 0.0096292 Sep 16 16:24:06.977048 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Deleting subnet 5d4f6eb2-1d35-4864-bb8e-46b8ccaaae5f {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:24:06.980319 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:06.985480 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-d02ac74b-d955-47e8-b8a6-7864e1cc6f83 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=f5178fe3547b432792996a0b47d8a025&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0296879 Sep 16 16:24:07.024449 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.066383 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.106296 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-20a315a1-34af-49c5-8966-d4cace0edb63 service neutron] 10.222.0.59 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1124012 Sep 16 16:24:07.136615 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.162441 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5d4f6eb2-1d35-4864-bb8e-46b8ccaaae5f,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:07.173559 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.178021 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/5d4f6eb2-1d35-4864-bb8e-46b8ccaaae5f HTTP/1.1" status: 204 len: 168 time: 0.2493355 Sep 16 16:24:07.178628 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39490) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:07.181681 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.182517 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.183357 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.183710 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.184050 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.184385 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.184738 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.185068 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.185887 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.186228 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.186555 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.186879 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5719982a-7ea9-46ea-9908-afdfced8d245 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:07.231331 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-8202d28e-3acd-4a25-b5b5-3855f7e4c5fa service neutron] 10.222.0.59 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1183650 Sep 16 16:24:07.270694 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.366673 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.392583 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['98a3fd80-6f2d-45c7-abee-728e73c69fbb']}} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:07.404426 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4c11d33-6318-4ead-b709-aaa3d7dec911') {'for_net_delete': True} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:07.404650 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4c11d33-6318-4ead-b709-aaa3d7dec911') {} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:07.435619 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64152858'] for segment, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.471913 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f90497a4-03d9-4637-8602-935330e398e5 req-1441ff5b-c926-434a-980a-0f536fc16802 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 210 time: 0.0508103 Sep 16 16:24:07.483544 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.493752 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Releasing vlan 746 on physical network physnet1 to pool {{(pid=93950) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:24:07.494164 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-65204239'] for segment, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: Traceback (most recent call last): Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: timer() Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: cb(*args, **kw) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: return func(*args, **kwargs) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: self._notify() Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: self.callback(batched_events) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: event.method(event) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: return f(self, *a, **k) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._get(url).json() Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: return self.request(url, 'GET', **kwargs) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:24:07.496208 dv-cinder-805887-15-iscsi neutron-server[93950]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:24:07.556797 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.568232 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.572649 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] 10.222.0.59 "DELETE /v2.0/networks/98a3fd80-6f2d-45c7-abee-728e73c69fbb HTTP/1.1" status: 204 len: 168 time: 0.3903923 Sep 16 16:24:07.572844 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39510) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:07.592415 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c78e058f-8764-4a60-a310-b1cbfad4b65f admin admin] Pushing event deleted for resources: {'Network': ['ID=98a3fd80-6f2d-45c7-abee-728e73c69fbb,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:07.639108 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Deleting subnet 8fa8ecca-16c2-4b16-adda-2e12d18b1725 {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:24:07.643719 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.683619 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.731589 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.757028 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58851795-625f-443a-85df-404aa764038a req-1ae3656c-f879-43ca-b334-b1b364b786d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:07.759481 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-1ae3656c-f879-43ca-b334-b1b364b786d6 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0688353 Sep 16 16:24:07.837093 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67419052-29f4-439a-a39e-c1a6ac09ff72 req-f38c40e0-7730-4121-a5d9-7d457cc51b22 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:07.838639 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-67419052-29f4-439a-a39e-c1a6ac09ff72 req-f38c40e0-7730-4121-a5d9-7d457cc51b22 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1577134 Sep 16 16:24:07.856319 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.892949 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8fa8ecca-16c2-4b16-adda-2e12d18b1725,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:07.894284 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6794dd97-2e1e-4ebc-9498-08e89b2f3273 req-b1fd0e9b-3e10-48af-b836-cc41af39ca3b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:07.894913 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:07.896351 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6794dd97-2e1e-4ebc-9498-08e89b2f3273 req-b1fd0e9b-3e10-48af-b836-cc41af39ca3b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 944 time: 0.1074109 Sep 16 16:24:07.896781 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-030f8d22-32da-4b20-9891-3a7c21c1afc0 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/8fa8ecca-16c2-4b16-adda-2e12d18b1725 HTTP/1.1" status: 204 len: 168 time: 0.3230455 Sep 16 16:24:07.899910 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 39518) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:07.915932 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-67419052-29f4-439a-a39e-c1a6ac09ff72 req-dd0f78c9-046c-4eff-8d6e-271fb53b3a13 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692382 Sep 16 16:24:07.931816 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device c4a23598-f189-46c2-8418-2a4bc652cd85 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:07.953958 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58851795-625f-443a-85df-404aa764038a req-90ac6d00-04c4-42e3-993d-6454240e6df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:07.955986 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-90ac6d00-04c4-42e3-993d-6454240e6df5 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.1887846 Sep 16 16:24:07.984543 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port c4a23598-f189-46c2-8418-2a4bc652cd85 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:24:07.989351 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port c4a23598-f189-46c2-8418-2a4bc652cd85 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:07.989729 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.053761 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-9d68bcfc-992a-467e-9c05-d02be67eabfc service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 217 time: 0.0882506 Sep 16 16:24:08.058225 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6794dd97-2e1e-4ebc-9498-08e89b2f3273 req-e976e226-bdeb-40f7-8c1f-d9df1a14ee5f tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1469836 Sep 16 16:24:08.061570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.092658 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.119134 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4a23598-f189-46c2-8418-2a4bc652cd85'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:08.121413 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a96a4c40-9ca6-4c15-b9b7-470a3b7e05ce" -d '{"events": [{"server_uuid": "273adae0-6efc-4507-aa4d-869e04dc3e9f", "name": "network-vif-plugged", "status": "completed", "tag": "c4a23598-f189-46c2-8418-2a4bc652cd85"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:08.133654 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port c4a23598-f189-46c2-8418-2a4bc652cd85, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=c4a23598-f189-46c2-8418-2a4bc652cd85,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:08.138717 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.139659 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec469fde-4f83-4483-88eb-713a7a06f69c no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:24:08.151257 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58851795-625f-443a-85df-404aa764038a req-a0e3ddc0-36f0-4468-a348-00cdca20d90f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:08.152732 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-a0e3ddc0-36f0-4468-a348-00cdca20d90f service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0842566 Sep 16 16:24:08.182334 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c98c289-00e3-47ef-8663-8e88ac31daa6 x-openstack-request-id: req-3c98c289-00e3-47ef-8663-8e88ac31daa6 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:08.182686 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "273adae0-6efc-4507-aa4d-869e04dc3e9f", "name": "network-vif-plugged", "status": "completed", "tag": "c4a23598-f189-46c2-8418-2a4bc652cd85", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:08.182936 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-3c98c289-00e3-47ef-8663-8e88ac31daa6 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:08.183360 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4a23598-f189-46c2-8418-2a4bc652cd85', 'code': 200} Sep 16 16:24:08.186496 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: ec469fde-4f83-4483-88eb-713a7a06f69c {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:24:08.186843 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec469fde-4f83-4483-88eb-713a7a06f69c not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:24:08.214205 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=c4a23598-f189-46c2-8418-2a4bc652cd85,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:08.220093 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-2624f2ad-dd16-4699-b0d3-b640e9aff8a8 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0574200 Sep 16 16:24:08.221708 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.221815 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.222358 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.222818 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.223236 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.223584 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.223916 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.224245 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.224568 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.224908 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.225236 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.225554 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.225874 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:08.261189 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['882d9a4e-311e-49c9-b958-2ed88f100bb3']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:08.277388 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6b881510-9da1-4e23-bf9b-ca0ed3e3e7e7') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:08.277684 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6b881510-9da1-4e23-bf9b-ca0ed3e3e7e7') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:08.317320 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.338602 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.353467 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Releasing vlan 722 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:24:08.353862 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:24:08.355493 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:24:08.375683 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-eda62791-fe59-4b5a-b769-704d2ed9f40f service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1434214 Sep 16 16:24:08.375855 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6448c0-620a-4ad5-8197-59ccf717e1a3 req-4de761a3-493e-44e3-9e82-af90bff54f1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:08.377197 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6a6448c0-620a-4ad5-8197-59ccf717e1a3 req-4de761a3-493e-44e3-9e82-af90bff54f1e service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 1098 time: 0.0391781 Sep 16 16:24:08.418787 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6a6448c0-620a-4ad5-8197-59ccf717e1a3 req-5f2b03d3-53e0-4ce8-81ac-8bd203f82bb2 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0275764 Sep 16 16:24:08.435262 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.439077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.441506 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] 10.222.0.59 "DELETE /v2.0/networks/882d9a4e-311e-49c9-b958-2ed88f100bb3 HTTP/1.1" status: 204 len: 168 time: 0.5398283 Sep 16 16:24:08.484099 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d72ff1-4184-433f-a6a2-5466558fb86d admin admin] Pushing event deleted for resources: {'Network': ['ID=882d9a4e-311e-49c9-b958-2ed88f100bb3,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:08.517368 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58851795-625f-443a-85df-404aa764038a req-064a29c6-6528-46a3-bae5-c0d3267d42ae service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1159685 Sep 16 16:24:08.560201 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b6d0aa16-bc0f-494c-8201-bd22d232858f req-46007f01-4442-472a-a119-68216492b023 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 210 time: 0.0260830 Sep 16 16:24:08.626929 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 39530) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:08.665123 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-003a2a8a-fd48-462b-80de-e4d7589a5530 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=e148e600eab7455ea277ffbe9337d07f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0369918 Sep 16 16:24:08.667558 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39532) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:08.716546 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ddbf1b1e-5a3c-4313-8f25-acd62718fbdd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.740953 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ddbf1b1e-5a3c-4313-8f25-acd62718fbdd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.789990 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ddbf1b1e-5a3c-4313-8f25-acd62718fbdd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.792529 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ddbf1b1e-5a3c-4313-8f25-acd62718fbdd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:08.793661 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-ddbf1b1e-5a3c-4313-8f25-acd62718fbdd admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d9944647-5ba5-42d5-ac21-43edd349e517 HTTP/1.1" status: 204 len: 168 time: 0.1251209 Sep 16 16:24:08.801609 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbf1b1e-5a3c-4313-8f25-acd62718fbdd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9944647-5ba5-42d5-ac21-43edd349e517,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:09.000147 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-9e5401b1-130e-4619-b9a2-af9b9cf24df9 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:09.001607 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-9e5401b1-130e-4619-b9a2-af9b9cf24df9 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "GET /v2.0/networks?id=6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 200 len: 809 time: 0.1288602 Sep 16 16:24:09.019319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Request body: {'port': {'device_id': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5', 'admin_state_up': True, 'tenant_id': 'f5178fe3547b432792996a0b47d8a025'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:09.059781 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df1228c-1f38-414d-bb48-fa859dab67bf req-d2a8ff95-1ac4-4e36-9cb0-debcdb49aa1c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:09.061314 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7df1228c-1f38-414d-bb48-fa859dab67bf req-d2a8ff95-1ac4-4e36-9cb0-debcdb49aa1c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0582225 Sep 16 16:24:09.107158 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7df1228c-1f38-414d-bb48-fa859dab67bf req-ee6259ff-e80a-4743-a943-b5d067515780 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384824 Sep 16 16:24:09.190894 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Made reservation on behalf of f5178fe3547b432792996a0b47d8a025 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:24:09.191652 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39550) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:09.194327 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.220630 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1b8019-992e-4eed-aec5-edd2f477caca req-f7298b7c-a24b-47a8-b58f-41abff525b33 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:09.222141 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9c1b8019-992e-4eed-aec5-edd2f477caca req-f7298b7c-a24b-47a8-b58f-41abff525b33 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.0814109 Sep 16 16:24:09.234446 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-9d4c44b3-6838-449c-8376-4a557fcd787a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a38e00db3c2641e4987b5ea52e4c8ce6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0414484 Sep 16 16:24:09.236911 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39552) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:09.295241 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7366386-689a-41c5-8c34-56de96561cc4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.317343 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7366386-689a-41c5-8c34-56de96561cc4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.318661 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9c1b8019-992e-4eed-aec5-edd2f477caca req-6383053a-ffc5-430a-b31e-92db53cae381 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861883 Sep 16 16:24:09.364465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Allocated IP 172.20.0.5 (6552c4e5-d945-44f2-a079-8db3b3dd41c5/a059b6f3-51b1-44ce-96d4-f56363397303/b1c52d5b-bbf5-41b4-8327-96f414326e65) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:09.375073 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7366386-689a-41c5-8c34-56de96561cc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.377775 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a7366386-689a-41c5-8c34-56de96561cc4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.378915 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a7366386-689a-41c5-8c34-56de96561cc4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/5fdefe91-2fc3-49e7-b26c-771bcc0be79e HTTP/1.1" status: 204 len: 168 time: 0.1409347 Sep 16 16:24:09.386479 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7366386-689a-41c5-8c34-56de96561cc4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fdefe91-2fc3-49e7-b26c-771bcc0be79e,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:09.515578 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.554353 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.627250 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:09.630387 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:09.633457 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:09.682400 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Pushing event updated for resources: {'Port': ['ID=b1c52d5b-bbf5-41b4-8327-96f414326e65,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:09.694912 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:09.696191 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:09.710657 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-90295b23-eb39-4b11-ae35-3938162995a7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6962385 Sep 16 16:24:09.711408 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c177a93d-5140-4767-8443-45ac98569c50 req-17cd09cd-94fe-495b-8f42-fd09d978b21e tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:09.712891 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c177a93d-5140-4767-8443-45ac98569c50 req-17cd09cd-94fe-495b-8f42-fd09d978b21e tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 931 time: 0.0523677 Sep 16 16:24:09.730476 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Request body: {'port': {'device_id': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:09.754544 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c177a93d-5140-4767-8443-45ac98569c50 req-4bca95e0-bbc9-4aa2-9d67-d0f30e2c89a3 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331750 Sep 16 16:24:09.789286 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:10.068167 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b1c52d5b-bbf5-41b4-8327-96f414326e65 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:24:10.078454 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:10.096148 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Transition to ACTIVE for port object b1c52d5b-bbf5-41b4-8327-96f414326e65 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:24:10.101082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:10.159840 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Pushing event updated for resources: {'Port': ['ID=b1c52d5b-bbf5-41b4-8327-96f414326e65,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:10.269221 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320bd01b-2603-4ec5-9b17-d164f6e66b14 req-1b29769e-d0ab-4917-b5b1-e5c33948b8b6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:10.270862 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-320bd01b-2603-4ec5-9b17-d164f6e66b14 req-1b29769e-d0ab-4917-b5b1-e5c33948b8b6 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0870852 Sep 16 16:24:10.275817 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Attempting to bind port b1c52d5b-bbf5-41b4-8327-96f414326e65 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:10.276168 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Attempting to bind port b1c52d5b-bbf5-41b4-8327-96f414326e65 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:10.276451 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Attempting to bind port b1c52d5b-bbf5-41b4-8327-96f414326e65 on network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:10.287182 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Port b1c52d5b-bbf5-41b4-8327-96f414326e65 on network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:24:10.287523 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Attempting to bind port b1c52d5b-bbf5-41b4-8327-96f414326e65 on network 6552c4e5-d945-44f2-a079-8db3b3dd41c5 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:10.301047 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 23, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:10.301384 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Checking segment: {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:10.301757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Bound using segment: {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:10.302174 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Bound port: b1c52d5b-bbf5-41b4-8327-96f414326e65, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 738, 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:10.302531 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:10.350895 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-320bd01b-2603-4ec5-9b17-d164f6e66b14 req-ad712341-93c7-4446-b230-1e0fbea41d0c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721781 Sep 16 16:24:10.392410 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] For port b1c52d5b-bbf5-41b4-8327-96f414326e65, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:10.396278 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] For port b1c52d5b-bbf5-41b4-8327-96f414326e65, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:10.401744 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:10.436861 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:10.437476 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:10.438847 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] 10.222.0.66 "PUT /v2.0/ports/b1c52d5b-bbf5-41b4-8327-96f414326e65 HTTP/1.1" status: 200 len: 1093 time: 0.7132950 Sep 16 16:24:10.439302 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'tag': 'b1c52d5b-bbf5-41b4-8327-96f414326e65'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:10.441779 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7" -d '{"events": [{"name": "network-changed", "server_uuid": "932377d1-c07a-4797-8d72-77328cbd9cd7", "tag": "b1c52d5b-bbf5-41b4-8327-96f414326e65"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:10.474307 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20eaf64-329c-440a-9af6-32217571dc9a req-cd6b6c1a-a7d7-4e81-a096-100d198b3641 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:10.484193 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f20eaf64-329c-440a-9af6-32217571dc9a req-cd6b6c1a-a7d7-4e81-a096-100d198b3641 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.0681021 Sep 16 16:24:10.488598 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cfe3b1-cfca-4f96-aea2-462081670180 service neutron] Pushing event updated for resources: {'Port': ['ID=b1c52d5b-bbf5-41b4-8327-96f414326e65,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:10.528021 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-999cbd7c-758e-4334-af10-ecad74eac815 x-openstack-request-id: req-999cbd7c-758e-4334-af10-ecad74eac815 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:10.528337 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "932377d1-c07a-4797-8d72-77328cbd9cd7", "tag": "b1c52d5b-bbf5-41b4-8327-96f414326e65", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:10.528549 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-999cbd7c-758e-4334-af10-ecad74eac815 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:10.528938 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'tag': 'b1c52d5b-bbf5-41b4-8327-96f414326e65', 'status': 'completed', 'code': 200} Sep 16 16:24:10.529520 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f20eaf64-329c-440a-9af6-32217571dc9a req-53bcefce-078c-48d6-9c5a-75b2bf81dbc6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443840 Sep 16 16:24:10.549258 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-bf8de77f-a4d5-4f0a-95cd-08a9d5c449ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:10.551177 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-bf8de77f-a4d5-4f0a-95cd-08a9d5c449ff service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=f5178fe3547b432792996a0b47d8a025&device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 1096 time: 0.0537243 Sep 16 16:24:10.604929 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-99463909-7826-4f2b-900a-e0308a82d78e service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65 HTTP/1.1" status: 200 len: 217 time: 0.0397575 Sep 16 16:24:10.664404 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23dc225c-3bff-4d69-a962-95d680e5addc req-2f0b9b17-bd72-4c25-aa0e-9084c1a9e513 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:10.665870 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-2f0b9b17-bd72-4c25-aa0e-9084c1a9e513 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=a059b6f3-51b1-44ce-96d4-f56363397303 HTTP/1.1" status: 200 len: 849 time: 0.0491908 Sep 16 16:24:10.709934 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-9c12ce9c-e052-4ba2-9326-7faa7b2985a9 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=6552c4e5-d945-44f2-a079-8db3b3dd41c5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0303779 Sep 16 16:24:11.080336 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07ea46a-b6f2-42c1-b489-d2762524e225 req-74f87f54-ccf6-4cd1-8f21-a48ebf7bf590 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:11.081781 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a07ea46a-b6f2-42c1-b489-d2762524e225 req-74f87f54-ccf6-4cd1-8f21-a48ebf7bf590 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 943 time: 0.0696213 Sep 16 16:24:11.083496 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-75e09ace-3008-49bc-a604-4654a777a821 service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3572607 Sep 16 16:24:11.167622 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a07ea46a-b6f2-42c1-b489-d2762524e225 req-c1b350af-8d91-4239-9ca1-d374da8f6d7a tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796878 Sep 16 16:24:11.194740 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-23dc225c-3bff-4d69-a962-95d680e5addc req-dd9324bd-e2d1-43b2-b1c1-f2fd224e6985 service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1014037 Sep 16 16:24:11.279945 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-fc3cdc1a-fdf6-49d8-a687-0e23f47becb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:11.281394 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-fc3cdc1a-fdf6-49d8-a687-0e23f47becb5 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=f5178fe3547b432792996a0b47d8a025&device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 1096 time: 0.0383639 Sep 16 16:24:11.376675 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-4f618970-bd83-448e-8942-61ca5f0351fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:11.378082 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-4f618970-bd83-448e-8942-61ca5f0351fb service neutron] 10.222.0.66 "GET /v2.0/networks?id=6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 200 len: 910 time: 0.0835197 Sep 16 16:24:11.421957 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-c3464df3-b385-499b-a749-51db8eb0a95a service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65 HTTP/1.1" status: 200 len: 217 time: 0.0337241 Sep 16 16:24:11.487476 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-bda0e9db-3665-46e9-9907-933ed1959148 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:11.488936 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-bda0e9db-3665-46e9-9907-933ed1959148 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=a059b6f3-51b1-44ce-96d4-f56363397303 HTTP/1.1" status: 200 len: 849 time: 0.0488739 Sep 16 16:24:11.495448 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43cf193d-bf6f-4cdb-a83a-aa52246524fc req-d8e28374-049e-45f1-90a5-676695cf8e28 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:11.496954 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-43cf193d-bf6f-4cdb-a83a-aa52246524fc req-d8e28374-049e-45f1-90a5-676695cf8e28 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0599298 Sep 16 16:24:11.522662 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-8c6de3b4-be41-4169-9cd8-f9e06edc4b56 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=6552c4e5-d945-44f2-a079-8db3b3dd41c5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0248878 Sep 16 16:24:11.542927 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-43cf193d-bf6f-4cdb-a83a-aa52246524fc req-efacfc66-ba8c-4452-a796-8bcffa9c503c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366831 Sep 16 16:24:11.620124 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-ac2599ca-0f6d-41ec-b865-a2fa2dc4a94d service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846746 Sep 16 16:24:11.718704 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4e4cd82-fa46-44d3-96b1-4c338cb371a7 req-c6834633-21b7-4a27-b958-2c4180bf15af service neutron] 10.222.0.66 "GET /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880382 Sep 16 16:24:12.296533 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64362ac3-38e7-4e63-bf66-174d050db049 req-633cfd9c-66df-41a5-98c7-6fe41a312c4d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:12.298049 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-64362ac3-38e7-4e63-bf66-174d050db049 req-633cfd9c-66df-41a5-98c7-6fe41a312c4d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 943 time: 0.0507345 Sep 16 16:24:12.335124 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-64362ac3-38e7-4e63-bf66-174d050db049 req-fc3fc1a0-07f1-4c3d-9500-2c9edafd11f5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310726 Sep 16 16:24:12.668007 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004232d2-30ce-4382-964a-b85294c9d031 req-7c2a50d0-430f-4038-9578-f0670ac3d5ba tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:12.669466 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-004232d2-30ce-4382-964a-b85294c9d031 req-7c2a50d0-430f-4038-9578-f0670ac3d5ba tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0515902 Sep 16 16:24:12.705412 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-004232d2-30ce-4382-964a-b85294c9d031 req-53eb35d2-5fa7-4602-a8cf-a2f1ffbdfad4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299745 Sep 16 16:24:13.053965 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:24:13.447884 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79160318-327d-40d5-98bc-2b3a789e9e8d req-37fd3766-c7bc-48e6-ab7c-09a717b9e9c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:13.449141 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-79160318-327d-40d5-98bc-2b3a789e9e8d req-37fd3766-c7bc-48e6-ab7c-09a717b9e9c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 943 time: 0.0479205 Sep 16 16:24:13.487093 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-79160318-327d-40d5-98bc-2b3a789e9e8d req-ec4b2d45-d650-46e3-976e-a7049b6a4f28 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312877 Sep 16 16:24:13.817517 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afefe06e-a7e8-4fe7-bf82-29d99f9ff34f req-e3a67c8b-1195-4890-b452-969e8784457c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:13.818988 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-afefe06e-a7e8-4fe7-bf82-29d99f9ff34f req-e3a67c8b-1195-4890-b452-969e8784457c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0475950 Sep 16 16:24:13.858336 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-afefe06e-a7e8-4fe7-bf82-29d99f9ff34f req-35623ee2-37fc-44bb-ade7-c2b153eeb38b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332630 Sep 16 16:24:14.601391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acfe805a-b788-4ae9-ae6f-3349cd24a96e req-405a3113-2731-485e-94de-266a9c832087 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:14.602837 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-acfe805a-b788-4ae9-ae6f-3349cd24a96e req-405a3113-2731-485e-94de-266a9c832087 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 943 time: 0.0511148 Sep 16 16:24:14.639310 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-acfe805a-b788-4ae9-ae6f-3349cd24a96e req-c8469be0-495e-408b-86dd-f4224cbcdc7f tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306365 Sep 16 16:24:14.972673 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa44d688-0b49-4bae-8ede-0576fd290594 req-c634f9fc-e233-4110-94a1-d41bdf4e3958 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:14.974124 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa44d688-0b49-4bae-8ede-0576fd290594 req-c634f9fc-e233-4110-94a1-d41bdf4e3958 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0474114 Sep 16 16:24:15.013783 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aa44d688-0b49-4bae-8ede-0576fd290594 req-7c03ba9b-5b50-4bdd-bcc3-dc4459be8767 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332477 Sep 16 16:24:15.196519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device b1c52d5b-bbf5-41b4-8327-96f414326e65 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:24:15.221595 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:15.304295 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port b1c52d5b-bbf5-41b4-8327-96f414326e65, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:15.315277 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'b1c52d5b-bbf5-41b4-8327-96f414326e65', 'network_id': '6552c4e5-d945-44f2-a079-8db3b3dd41c5', 'port_id': 'b1c52d5b-bbf5-41b4-8327-96f414326e65', 'mac_address': 'fa:16:3e:70:d2:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 738, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a059b6f3-51b1-44ce-96d4-f56363397303', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:24:15.339251 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-7e95d2bf-0795-4c1b-9392-34571e4f4a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:15.340726 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-7e95d2bf-0795-4c1b-9392-34571e4f4a71 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0397632 Sep 16 16:24:15.351265 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:15.364083 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b1c52d5b-bbf5-41b4-8327-96f414326e65 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:24:15.382312 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port b1c52d5b-bbf5-41b4-8327-96f414326e65, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:15.386797 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:15.437522 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=b1c52d5b-bbf5-41b4-8327-96f414326e65,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:15.469507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-b197b72c-8b76-4543-8b46-5d1ff4433496 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:15.470897 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-b197b72c-8b76-4543-8b46-5d1ff4433496 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.0887012 Sep 16 16:24:15.523319 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-3126db91-23ac-4166-9ddd-b7ac78a6588a service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 217 time: 0.0363250 Sep 16 16:24:15.578255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-8a2feb4a-d8e0-4e9d-8e02-7b5aa6d80cf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:15.579724 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-8a2feb4a-d8e0-4e9d-8e02-7b5aa6d80cf5 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0472405 Sep 16 16:24:15.610992 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-27fe7ecb-5f59-4aa5-a0c5-95384267ae0a service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0227098 Sep 16 16:24:15.711033 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-23283b52-a987-4be1-b28c-9bd42f005139 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895846 Sep 16 16:24:15.757258 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8795a2c3-cea3-42eb-a6b8-13080021c887 req-fb918061-06e5-4f5f-9d1d-f3ddbe6cfc53 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:15.758662 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8795a2c3-cea3-42eb-a6b8-13080021c887 req-fb918061-06e5-4f5f-9d1d-f3ddbe6cfc53 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 944 time: 0.0509262 Sep 16 16:24:15.795947 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8795a2c3-cea3-42eb-a6b8-13080021c887 req-88ac6129-63d9-429d-8428-d8d23a4ba8c8 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313289 Sep 16 16:24:15.803695 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1550ed3e-06af-48c7-bbd7-364d2f48fd2d req-6a734861-14dd-4c21-b4e8-884f4f1458e6 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830262 Sep 16 16:24:16.137509 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e29a8d-460d-4ec1-96ea-e0481fadb0be req-a827604b-196d-4912-ac88-4a92e3b907eb tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:16.138999 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00e29a8d-460d-4ec1-96ea-e0481fadb0be req-a827604b-196d-4912-ac88-4a92e3b907eb tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0513377 Sep 16 16:24:16.179783 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00e29a8d-460d-4ec1-96ea-e0481fadb0be req-c7a366db-ccd2-4d33-96fb-b2b1efd7443e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348289 Sep 16 16:24:16.910053 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d57f60-c8a3-4e4a-b287-b76ec0106df1 req-ac23b2b9-50c4-4823-abe2-0cab86ea59e7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:16.911549 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a8d57f60-c8a3-4e4a-b287-b76ec0106df1 req-ac23b2b9-50c4-4823-abe2-0cab86ea59e7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 944 time: 0.0473542 Sep 16 16:24:16.949590 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a8d57f60-c8a3-4e4a-b287-b76ec0106df1 req-afa34b7b-598a-400b-9325-d03c45395da7 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314322 Sep 16 16:24:17.290459 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1601335e-4ebc-4133-abbd-eeb86f230ef0 req-12d00b9e-db78-45df-9cc5-e2bd9074adbe tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:17.291951 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1601335e-4ebc-4133-abbd-eeb86f230ef0 req-12d00b9e-db78-45df-9cc5-e2bd9074adbe tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0474696 Sep 16 16:24:17.328766 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1601335e-4ebc-4133-abbd-eeb86f230ef0 req-fca8b774-9c25-4b15-8fc5-a0d8f4eb2e21 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310154 Sep 16 16:24:18.068899 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830061d3-3274-439f-8d85-1e46594d5304 req-fd4716d5-3ad7-4d8d-8470-5a2db1c0f0b2 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:18.070349 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-830061d3-3274-439f-8d85-1e46594d5304 req-fd4716d5-3ad7-4d8d-8470-5a2db1c0f0b2 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 944 time: 0.0556197 Sep 16 16:24:18.111756 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-830061d3-3274-439f-8d85-1e46594d5304 req-360d90be-f186-445d-92e1-8cc722726eea tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316792 Sep 16 16:24:18.437283 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1f7377-4518-4263-a662-dcae02e033bd req-58b78ff4-688f-4464-b402-39f32a7f9f7b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:18.438690 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a1f7377-4518-4263-a662-dcae02e033bd req-58b78ff4-688f-4464-b402-39f32a7f9f7b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0455940 Sep 16 16:24:18.474774 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a1f7377-4518-4263-a662-dcae02e033bd req-90c75ac5-d497-4225-a521-67f268c3d9f4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0298345 Sep 16 16:24:19.225178 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6a8e5-307b-4ba5-89dc-786f53384689 req-eaa62cbd-05e6-4cad-ba49-99a2c84a795d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:19.226657 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7ae6a8e5-307b-4ba5-89dc-786f53384689 req-eaa62cbd-05e6-4cad-ba49-99a2c84a795d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 944 time: 0.0480652 Sep 16 16:24:19.263561 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7ae6a8e5-307b-4ba5-89dc-786f53384689 req-123cb59c-a7f6-46d8-a4bd-9768d0560846 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308976 Sep 16 16:24:19.593812 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c041b09-c99d-4b12-919e-30d9002804fe req-c9168f6a-a29f-4d09-aa2e-7c7bd44b31d5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:19.595146 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c041b09-c99d-4b12-919e-30d9002804fe req-c9168f6a-a29f-4d09-aa2e-7c7bd44b31d5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0562665 Sep 16 16:24:19.641334 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c041b09-c99d-4b12-919e-30d9002804fe req-45938967-4a74-42cf-8083-910d4c56e90f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396402 Sep 16 16:24:19.873185 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['b1c52d5b-bbf5-41b4-8327-96f414326e65'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:20.394879 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e73b27b5-5cde-4bd9-834f-42310b59e449 req-f73aa40e-66cf-477f-af04-32edef1559d6 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:20.396564 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e73b27b5-5cde-4bd9-834f-42310b59e449 req-f73aa40e-66cf-477f-af04-32edef1559d6 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 944 time: 0.0542712 Sep 16 16:24:20.439669 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e73b27b5-5cde-4bd9-834f-42310b59e449 req-f2490ba7-11a9-41e6-b1bd-c2a09252bd14 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344625 Sep 16 16:24:20.525781 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7d7d43-d383-4a8d-a502-2d12868af65f req-18dbcb32-5bab-4e6d-a2c8-7057f27fbcd8 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:20.527298 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7b7d7d43-d383-4a8d-a502-2d12868af65f req-18dbcb32-5bab-4e6d-a2c8-7057f27fbcd8 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0484817 Sep 16 16:24:20.565045 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7b7d7d43-d383-4a8d-a502-2d12868af65f req-25fe6e1b-eddb-4d37-a562-d8a465a1d393 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318496 Sep 16 16:24:20.715611 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f56e8072-245b-42a6-8e67-78012c917fcf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:20.761199 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48cd0676-0415-4c02-b0f0-fce3d4ea083a req-cf3c186d-197e-49bf-8fbe-54bcf775edce tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:20.762650 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-48cd0676-0415-4c02-b0f0-fce3d4ea083a req-cf3c186d-197e-49bf-8fbe-54bcf775edce tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0540726 Sep 16 16:24:20.799838 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-48cd0676-0415-4c02-b0f0-fce3d4ea083a req-4b5badee-d841-483f-a755-3a0b81f83b50 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310256 Sep 16 16:24:21.553553 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-541c7d45-377b-4d71-9c4e-d4cf168b7646 req-319e3f53-1f42-49f2-ba33-ae7ec777930d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:21.555026 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-541c7d45-377b-4d71-9c4e-d4cf168b7646 req-319e3f53-1f42-49f2-ba33-ae7ec777930d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 944 time: 0.0484049 Sep 16 16:24:21.593007 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-541c7d45-377b-4d71-9c4e-d4cf168b7646 req-55fc31df-8d3d-40fd-8f88-6a1e9c90ec16 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314918 Sep 16 16:24:21.680821 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c264d6ec-8ed9-487b-9717-a2bd0b906f4c req-8ba02f0b-9fd8-480d-8313-e7936e012e44 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:21.682919 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c264d6ec-8ed9-487b-9717-a2bd0b906f4c req-8ba02f0b-9fd8-480d-8313-e7936e012e44 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0468640 Sep 16 16:24:21.718764 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c264d6ec-8ed9-487b-9717-a2bd0b906f4c req-0d575ef0-ba54-4f39-9085-bef7e33430cb tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0299373 Sep 16 16:24:21.909045 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67209677-f0a8-4eb1-a6d1-954192ed0fb6 req-38b618ca-3f69-4cc0-b6fb-27515287c549 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:21.910489 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-67209677-f0a8-4eb1-a6d1-954192ed0fb6 req-38b618ca-3f69-4cc0-b6fb-27515287c549 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0462866 Sep 16 16:24:21.950823 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-67209677-f0a8-4eb1-a6d1-954192ed0fb6 req-b4129440-5083-4b9a-beca-9d21cfe6c331 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340931 Sep 16 16:24:22.147047 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device b1c52d5b-bbf5-41b4-8327-96f414326e65 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:22.194356 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port b1c52d5b-bbf5-41b4-8327-96f414326e65 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:24:22.197963 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port b1c52d5b-bbf5-41b4-8327-96f414326e65 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:22.198334 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:22.274118 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:22.296680 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1c52d5b-bbf5-41b4-8327-96f414326e65'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:22.298901 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfa09d9b-69f2-493d-9165-205cf36d8ca8" -d '{"events": [{"server_uuid": "932377d1-c07a-4797-8d72-77328cbd9cd7", "name": "network-vif-plugged", "status": "completed", "tag": "b1c52d5b-bbf5-41b4-8327-96f414326e65"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:22.311518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port b1c52d5b-bbf5-41b4-8327-96f414326e65, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:22.321337 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:22.344307 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03ec611c-9b16-4fe7-bae4-89979708f7b1 x-openstack-request-id: req-03ec611c-9b16-4fe7-bae4-89979708f7b1 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:22.344592 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "932377d1-c07a-4797-8d72-77328cbd9cd7", "name": "network-vif-plugged", "status": "completed", "tag": "b1c52d5b-bbf5-41b4-8327-96f414326e65", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:22.344844 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-03ec611c-9b16-4fe7-bae4-89979708f7b1 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:22.345227 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1c52d5b-bbf5-41b4-8327-96f414326e65', 'code': 200} Sep 16 16:24:22.370477 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=b1c52d5b-bbf5-41b4-8327-96f414326e65,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:22.520676 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec559841-f25d-45d5-b28b-86af461692c5 req-305e93fe-d524-4f83-b18b-455a1e2d4463 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:22.522141 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ec559841-f25d-45d5-b28b-86af461692c5 req-305e93fe-d524-4f83-b18b-455a1e2d4463 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 1098 time: 0.0381176 Sep 16 16:24:22.564087 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ec559841-f25d-45d5-b28b-86af461692c5 req-698c0891-50e9-41ab-952e-8dc3cc70996a service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0286851 Sep 16 16:24:22.709273 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4f477e-d0ee-45d8-abb2-010e88f55bfd req-8ee71b8a-7e1e-4db6-86e8-fd8b37604f3d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:22.710899 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1b4f477e-d0ee-45d8-abb2-010e88f55bfd req-8ee71b8a-7e1e-4db6-86e8-fd8b37604f3d tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0515385 Sep 16 16:24:22.766818 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1b4f477e-d0ee-45d8-abb2-010e88f55bfd req-280f8cbb-6b2f-4459-a45a-a06278efeb66 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493653 Sep 16 16:24:22.860330 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea557156-8e2f-43bf-87e2-7f62362e6920 req-343c2605-81df-444f-a4f1-8dab9d3b78f6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:22.861830 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ea557156-8e2f-43bf-87e2-7f62362e6920 req-343c2605-81df-444f-a4f1-8dab9d3b78f6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0592113 Sep 16 16:24:22.899425 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ea557156-8e2f-43bf-87e2-7f62362e6920 req-860d0912-7149-41be-9824-ae2c93013f45 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316679 Sep 16 16:24:23.062780 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2de3256-3448-42cb-8843-1b027fed34b2 req-efe81919-3712-4732-bd11-c9778ac98185 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:23.064270 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e2de3256-3448-42cb-8843-1b027fed34b2 req-efe81919-3712-4732-bd11-c9778ac98185 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0481470 Sep 16 16:24:23.105827 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e2de3256-3448-42cb-8843-1b027fed34b2 req-49ee8102-05bd-470b-b06d-a71e37c7db91 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353403 Sep 16 16:24:23.438856 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-262f299d-9f99-4613-8910-87b1a10d6b38 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:23.716184 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:23.892545 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2987e11e-6d19-4a86-b935-e499e4ee6284 req-20a8d86b-262f-4e0c-8d3e-c7c12f651785 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:23.894236 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2987e11e-6d19-4a86-b935-e499e4ee6284 req-20a8d86b-262f-4e0c-8d3e-c7c12f651785 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0526049 Sep 16 16:24:23.933769 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2987e11e-6d19-4a86-b935-e499e4ee6284 req-542aab9b-fb3f-41fc-9d23-aa0eb62da985 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334780 Sep 16 16:24:24.027059 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82b539b-fb76-4237-ba1a-7ae806520a00 req-a7e009d3-ab84-442e-9cb4-1794551c3659 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:24.029571 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d82b539b-fb76-4237-ba1a-7ae806520a00 req-a7e009d3-ab84-442e-9cb4-1794551c3659 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0565023 Sep 16 16:24:24.073235 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d82b539b-fb76-4237-ba1a-7ae806520a00 req-7b696cf1-fac0-4864-8cd5-42f6db22c674 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372386 Sep 16 16:24:24.218694 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c69860-8edf-449a-862a-3136434e6a88 req-b1259944-a988-446a-9620-0ac15388abca tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:24.220248 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-15c69860-8edf-449a-862a-3136434e6a88 req-b1259944-a988-446a-9620-0ac15388abca tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0495546 Sep 16 16:24:24.256632 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-15c69860-8edf-449a-862a-3136434e6a88 req-497d9f3c-35c8-482f-ba41-4fde63620612 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304887 Sep 16 16:24:24.352865 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:25.046230 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9387b00-bc55-4415-bfd1-6518a7da8b67 req-d696586a-b557-4613-8ed7-13e61448d99c tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:25.047764 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e9387b00-bc55-4415-bfd1-6518a7da8b67 req-d696586a-b557-4613-8ed7-13e61448d99c tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0483654 Sep 16 16:24:25.086207 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e9387b00-bc55-4415-bfd1-6518a7da8b67 req-de4f9720-2453-498a-9b75-4190d432c481 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324299 Sep 16 16:24:25.184880 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdd5b5d-3c8d-4dcd-bf91-c3caa5efe6ef req-bcb2f74b-58f5-4bc5-94c3-1d661dd9bae7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:25.186246 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5cdd5b5d-3c8d-4dcd-bf91-c3caa5efe6ef req-bcb2f74b-58f5-4bc5-94c3-1d661dd9bae7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0462329 Sep 16 16:24:25.223573 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5cdd5b5d-3c8d-4dcd-bf91-c3caa5efe6ef req-8d609ffd-1963-4398-a500-f02c7e78fc5f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311892 Sep 16 16:24:25.368041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605d940f-2d04-4a70-ac3a-9845743ab35d req-011f0b58-f404-4167-b673-28e48c273c7b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:25.370073 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-605d940f-2d04-4a70-ac3a-9845743ab35d req-011f0b58-f404-4167-b673-28e48c273c7b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0471466 Sep 16 16:24:25.409818 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-605d940f-2d04-4a70-ac3a-9845743ab35d req-b917f415-4f41-41be-b919-5de225d191be tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339324 Sep 16 16:24:26.171911 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:26.338118 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ddf05d-888a-4ff7-8b37-33850b05eace req-fca0d6c1-85a5-4c96-8159-1c578bf203e8 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:26.339608 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-97ddf05d-888a-4ff7-8b37-33850b05eace req-fca0d6c1-85a5-4c96-8159-1c578bf203e8 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0511081 Sep 16 16:24:26.375037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-97ddf05d-888a-4ff7-8b37-33850b05eace req-2d6f6df6-00a6-4963-bd0a-886163be89c2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0295360 Sep 16 16:24:26.521089 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a029412-ef25-48a1-b1ac-b2b4fa53bee5 req-b7fe0dea-15bc-4f1b-849a-eabf10215522 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:26.522564 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1a029412-ef25-48a1-b1ac-b2b4fa53bee5 req-b7fe0dea-15bc-4f1b-849a-eabf10215522 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0469787 Sep 16 16:24:26.560487 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1a029412-ef25-48a1-b1ac-b2b4fa53bee5 req-139928c7-3159-4dcd-9a9b-bba12e3841a3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311158 Sep 16 16:24:27.488014 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e29ecb6-8fcd-496e-a0ae-738b3ad9beb6 req-d6ac7e02-6fe2-4c81-a4fb-2fc38f6a2786 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:27.489507 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3e29ecb6-8fcd-496e-a0ae-738b3ad9beb6 req-d6ac7e02-6fe2-4c81-a4fb-2fc38f6a2786 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0497921 Sep 16 16:24:27.526359 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3e29ecb6-8fcd-496e-a0ae-738b3ad9beb6 req-89fad32a-7a18-4d8f-9880-dbbbcd098b06 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310342 Sep 16 16:24:27.678929 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fea933c5-d60d-4a0d-b5ba-b33406d8cd03 req-c7801c7e-831a-48f0-9fe5-bb1da51ef79f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:27.680669 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fea933c5-d60d-4a0d-b5ba-b33406d8cd03 req-c7801c7e-831a-48f0-9fe5-bb1da51ef79f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0508189 Sep 16 16:24:27.718955 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fea933c5-d60d-4a0d-b5ba-b33406d8cd03 req-a061a5f4-ace0-4648-bf0c-22e3a2912b4b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326450 Sep 16 16:24:28.370610 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12b8fc9-9ce5-4a0f-9aef-095cde617044 req-8c30136f-f6ba-4c99-9607-99d6a8c071a4 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:28.372130 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c12b8fc9-9ce5-4a0f-9aef-095cde617044 req-8c30136f-f6ba-4c99-9607-99d6a8c071a4 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0478380 Sep 16 16:24:28.415118 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c12b8fc9-9ce5-4a0f-9aef-095cde617044 req-c7a31da9-0099-4867-a208-7bd2ed0c5463 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366428 Sep 16 16:24:28.644581 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480f7c8a-8f8d-4bbd-b325-655cd00b7fd5 req-3a96eb89-8a85-4d97-8ca5-b54bc58cc5c7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:28.645966 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-480f7c8a-8f8d-4bbd-b325-655cd00b7fd5 req-3a96eb89-8a85-4d97-8ca5-b54bc58cc5c7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0478435 Sep 16 16:24:28.685915 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-480f7c8a-8f8d-4bbd-b325-655cd00b7fd5 req-77dc844d-ae40-403c-ab7d-6c753aff85c3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0334091 Sep 16 16:24:28.831202 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68b959e-e63d-4556-ac72-7e67d56bf161 req-e7ef8610-3df3-4105-a333-9b2f6a408b8e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:28.832663 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c68b959e-e63d-4556-ac72-7e67d56bf161 req-e7ef8610-3df3-4105-a333-9b2f6a408b8e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0486932 Sep 16 16:24:28.878226 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c68b959e-e63d-4556-ac72-7e67d56bf161 req-c9b4e4ea-7aca-4696-9104-60dc361043c4 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359514 Sep 16 16:24:29.538901 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73f01f-8851-4ce3-a0b1-143761c425c9 req-caf9b5c9-0dc4-4b3e-82ce-aceb60136deb tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:29.540440 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0b73f01f-8851-4ce3-a0b1-143761c425c9 req-caf9b5c9-0dc4-4b3e-82ce-aceb60136deb tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0519876 Sep 16 16:24:29.582546 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0b73f01f-8851-4ce3-a0b1-143761c425c9 req-e5d857cb-d30e-4a79-a349-5bcbdebc4bbc tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358839 Sep 16 16:24:29.798628 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42742438-18fb-4f22-bebe-118b9a919c26 req-d52c8110-09e8-4999-a3e3-f377337c3fca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:29.800147 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-42742438-18fb-4f22-bebe-118b9a919c26 req-d52c8110-09e8-4999-a3e3-f377337c3fca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0464048 Sep 16 16:24:29.837825 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-42742438-18fb-4f22-bebe-118b9a919c26 req-f9462cdc-73dc-4a9c-8e81-7713bafe1521 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317852 Sep 16 16:24:29.999322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fff68a6-c615-4b2f-a469-47b7a99ee04b req-c74df081-b16b-4ec3-9367-8884499df205 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:30.000829 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0fff68a6-c615-4b2f-a469-47b7a99ee04b req-c74df081-b16b-4ec3-9367-8884499df205 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0540769 Sep 16 16:24:30.042858 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-0fff68a6-c615-4b2f-a469-47b7a99ee04b req-c933669b-0f22-4c12-940e-65e50f035273 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357349 Sep 16 16:24:30.701456 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d683b7f-7968-4c43-b24d-d7786c849426 req-001f858a-745b-42bf-bd9b-cb900f4b14bb tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:30.702918 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9d683b7f-7968-4c43-b24d-d7786c849426 req-001f858a-745b-42bf-bd9b-cb900f4b14bb tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0512185 Sep 16 16:24:30.740701 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9d683b7f-7968-4c43-b24d-d7786c849426 req-31c71898-5a42-4988-849f-4fbdfb084460 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/security-groups?id=994c0e1d-ee8c-408f-bc54-75e786c084ab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315657 Sep 16 16:24:30.956446 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2429e112-81bb-4c85-bc0c-a42d39ad4615 req-e0a042b6-c718-4590-b2f0-dacaae07937c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:30.957917 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2429e112-81bb-4c85-bc0c-a42d39ad4615 req-e0a042b6-c718-4590-b2f0-dacaae07937c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0531876 Sep 16 16:24:30.994310 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2429e112-81bb-4c85-bc0c-a42d39ad4615 req-dbf8a593-7478-4501-8449-0b8d0d73a657 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0298321 Sep 16 16:24:31.161517 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb62a47d-576e-48e7-ab1a-7abd8f07c6b7 req-00d22341-8118-478e-91bc-6f2b10fd0bcc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:31.162976 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-eb62a47d-576e-48e7-ab1a-7abd8f07c6b7 req-00d22341-8118-478e-91bc-6f2b10fd0bcc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0467873 Sep 16 16:24:31.204347 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-eb62a47d-576e-48e7-ab1a-7abd8f07c6b7 req-a7a3184b-0865-4da7-a0b5-bb25acd5f735 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347307 Sep 16 16:24:31.262883 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-9245daea-216a-48c7-8e93-66e4dac4b9f3 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:31.264193 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-9245daea-216a-48c7-8e93-66e4dac4b9f3 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 945 time: 0.0459313 Sep 16 16:24:31.354086 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Deleting port b1c52d5b-bbf5-41b4-8327-96f414326e65 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:24:31.354418 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:31.439390 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] For port b1c52d5b-bbf5-41b4-8327-96f414326e65, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=b1c52d5b-bbf5-41b4-8327-96f414326e65,segment=NetworkSegment(abe40faa-ea6a-4cb2-b2fb-49b96ee48698),segment_id=abe40faa-ea6a-4cb2-b2fb-49b96ee48698)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:31.439744 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:31.451579 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Calling delete_port for b1c52d5b-bbf5-41b4-8327-96f414326e65 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:24:31.575098 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:31.593567 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['b1c52d5b-bbf5-41b4-8327-96f414326e65'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:31.603022 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Pushing event deleted for resources: {'Port': ['ID=b1c52d5b-bbf5-41b4-8327-96f414326e65,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:31.641191 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] No DVR routers for this DVR port b1c52d5b-bbf5-41b4-8327-96f414326e65 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:24:31.644214 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:31.646176 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87e5216d-a04b-474a-afdb-a4110dc00501 req-ce7843a2-3b86-4373-9dd3-85bba53ba3c5 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.66 "DELETE /v2.0/ports/b1c52d5b-bbf5-41b4-8327-96f414326e65 HTTP/1.1" status: 204 len: 173 time: 0.3722394 Sep 16 16:24:31.646607 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'name': 'network-vif-deleted', 'tag': 'b1c52d5b-bbf5-41b4-8327-96f414326e65'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:31.648840 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acdaccd8-f300-4e05-80f8-1f299c366bc9" -d '{"events": [{"server_uuid": "932377d1-c07a-4797-8d72-77328cbd9cd7", "name": "network-vif-deleted", "tag": "b1c52d5b-bbf5-41b4-8327-96f414326e65"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:31.684276 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a5d6743-ac96-43c1-9a67-5c70a9cc0c7b x-openstack-request-id: req-9a5d6743-ac96-43c1-9a67-5c70a9cc0c7b {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:31.684573 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "932377d1-c07a-4797-8d72-77328cbd9cd7", "name": "network-vif-deleted", "tag": "b1c52d5b-bbf5-41b4-8327-96f414326e65", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:31.684827 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-9a5d6743-ac96-43c1-9a67-5c70a9cc0c7b {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:31.685218 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '932377d1-c07a-4797-8d72-77328cbd9cd7', 'name': 'network-vif-deleted', 'tag': 'b1c52d5b-bbf5-41b4-8327-96f414326e65', 'status': 'completed', 'code': 200} Sep 16 16:24:31.845731 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c63cb48d-4732-43db-9875-7424c318428d req-66640c58-ea95-4734-a476-17246cc88cb6 tempest-VolumesActionsTest-1613597760 tempest-VolumesActionsTest-1613597760-project] 10.222.0.59 "GET /v2.0/ports?device_id=932377d1-c07a-4797-8d72-77328cbd9cd7 HTTP/1.1" status: 200 len: 210 time: 0.0255115 Sep 16 16:24:32.107884 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf2f8fd-7879-49d1-a5c6-577425bd1f21 req-689029a2-98b2-46ab-8582-988c13379dc9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:32.109517 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3cf2f8fd-7879-49d1-a5c6-577425bd1f21 req-689029a2-98b2-46ab-8582-988c13379dc9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0494645 Sep 16 16:24:32.162738 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3cf2f8fd-7879-49d1-a5c6-577425bd1f21 req-0ea83a04-c38b-49fa-87a4-e13e8ab5260c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457230 Sep 16 16:24:32.266955 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 39958) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:32.329603 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60905f47-d9a3-4c62-8721-3015e752fb75 req-69be0bad-2180-4a7b-b2ae-f827e400eee1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:32.331075 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-60905f47-d9a3-4c62-8721-3015e752fb75 req-69be0bad-2180-4a7b-b2ae-f827e400eee1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0504982 Sep 16 16:24:32.369150 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-60905f47-d9a3-4c62-8721-3015e752fb75 req-ac821552-9931-42c2-98e2-82450135b701 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313323 Sep 16 16:24:32.378959 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-529e7917-3f5e-4c6a-b1c7-d95bafbd8530 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.467656 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-529e7917-3f5e-4c6a-b1c7-d95bafbd8530 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.471324 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-529e7917-3f5e-4c6a-b1c7-d95bafbd8530 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.507682 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-529e7917-3f5e-4c6a-b1c7-d95bafbd8530 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f7836bea36ad44f696895cad3ea8859a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2395470 Sep 16 16:24:32.509589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529e7917-3f5e-4c6a-b1c7-d95bafbd8530 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccccea75-a2ed-4bce-a700-5971248c56fd,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:32.510412 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 39962) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:32.558302 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f4a8a68-0c49-437e-8881-c75f25ea56f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.578449 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f4a8a68-0c49-437e-8881-c75f25ea56f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.625819 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f4a8a68-0c49-437e-8881-c75f25ea56f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.628617 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f4a8a68-0c49-437e-8881-c75f25ea56f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:32.630002 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3f4a8a68-0c49-437e-8881-c75f25ea56f1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/ccccea75-a2ed-4bce-a700-5971248c56fd HTTP/1.1" status: 204 len: 168 time: 0.1182930 Sep 16 16:24:32.637544 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f4a8a68-0c49-437e-8881-c75f25ea56f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccccea75-a2ed-4bce-a700-5971248c56fd,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:33.256849 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40008) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:33.289140 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55498375-f40b-4d4f-83a2-91f52b284a15 req-9949e56f-0185-4313-9e11-047d1ccae65e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:33.291175 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-55498375-f40b-4d4f-83a2-91f52b284a15 req-9949e56f-0185-4313-9e11-047d1ccae65e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0513794 Sep 16 16:24:33.335919 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-55498375-f40b-4d4f-83a2-91f52b284a15 req-32e406b2-39da-4a16-af92-c8c1c88db3ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377002 Sep 16 16:24:33.368296 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-894245059-network', 'tenant_id': '3320c65285f54af487d03b845f596772'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:33.389130 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Made reservation on behalf of 3320c65285f54af487d03b845f596772 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:24:33.393098 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.402260 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.516602 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656f6109-7d02-4364-8ead-517a1c59df88 req-56a65dce-58b4-4b50-aea3-a69fd9fa76f1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:33.518278 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-656f6109-7d02-4364-8ead-517a1c59df88 req-56a65dce-58b4-4b50-aea3-a69fd9fa76f1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0722282 Sep 16 16:24:33.557348 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.567555 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.586253 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-656f6109-7d02-4364-8ead-517a1c59df88 req-f57eafb2-1bbb-42ad-ab39-97c93aea41f7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620682 Sep 16 16:24:33.595084 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 718} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:24:33.610758 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6148800b-c70a-4fb2-8809-175c22b0cf1e,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:33.614080 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.614486 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Added segment 7bdee358-0ffe-449a-8264-a3184229e5b4 of type vlan for network e657e2d9-d56a-46a2-987f-ea59605a973c Sep 16 16:24:33.664354 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.690776 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.691877 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:33.692496 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:33.750016 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4920640 Sep 16 16:24:33.752809 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40042) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:33.754727 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3634f81e-5494-4261-98c3-6330f23ae759 admin admin] Pushing event updated for resources: {'Network': ['ID=e657e2d9-d56a-46a2-987f-ea59605a973c,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:33.761701 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Request body: {'subnet': {'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-894245059-subnet', 'tenant_id': '3320c65285f54af487d03b845f596772', 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:33.766007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network e657e2d9-d56a-46a2-987f-ea59605a973c details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:24:33.786620 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Made reservation on behalf of 3320c65285f54af487d03b845f596772 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:24:33.789111 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64151728'] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.121548 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-65205906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64151710'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.176405 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b5db019-2ec2-4635-90ac-83301ff8e797,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:34.186518 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Checking segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:34.186868 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Network hostable DHCP agents. Network: e657e2d9-d56a-46a2-987f-ea59605a973c, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:24:34.202768 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Network e657e2d9-d56a-46a2-987f-ea59605a973c is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:24:34.211445 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, e657e2d9-d56a-46a2-987f-ea59605a973c) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:34.216063 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:34.216656 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.221518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e414dd2-e2f4-4563-abcb-b8b70d2f80c0 None None] Network e657e2d9-d56a-46a2-987f-ea59605a973c requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:24:34.230855 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-6641abb0-02ce-4a48-b34e-6b5f615310a8 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4769022 Sep 16 16:24:34.233555 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40044) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:34.237786 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:34.258305 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.258851 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.311573 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.371529 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-e657e2d9-d56a-46a2-987f-ea59605a973c', 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c', 'tenant_id': '3320c65285f54af487d03b845f596772', 'fixed_ips': [{'subnet_id': '4b5db019-2ec2-4635-90ac-83301ff8e797'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:24:34.372396 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.469428 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.506664 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36548c2-75af-407b-a9f9-e1bd1eb6e044 req-9c415eca-a994-4361-9a68-d1439351f3a7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:34.507960 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Allocated IP 172.20.0.2 (e657e2d9-d56a-46a2-987f-ea59605a973c/4b5db019-2ec2-4635-90ac-83301ff8e797/c4e418d2-30cd-4d01-a800-ebfcb06cd4b8) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:34.510000 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c36548c2-75af-407b-a9f9-e1bd1eb6e044 req-9c415eca-a994-4361-9a68-d1439351f3a7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0962734 Sep 16 16:24:34.580071 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c36548c2-75af-407b-a9f9-e1bd1eb6e044 req-6512ac0c-92e1-49a3-8332-648b1eac0e87 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0638852 Sep 16 16:24:34.651158 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.656798 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.695850 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Network e657e2d9-d56a-46a2-987f-ea59605a973c is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:34.699424 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:34.704224 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:34.716513 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Pushing event updated for resources: {'Port': ['ID=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:34.721295 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d3eacf-6829-4319-b041-c5b2dd341d8c req-53b68377-386e-499b-9627-5452055ffa88 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:34.721917 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.723492 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-82d3eacf-6829-4319-b041-c5b2dd341d8c req-53b68377-386e-499b-9627-5452055ffa88 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0647738 Sep 16 16:24:34.740973 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.764305 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-82d3eacf-6829-4319-b041-c5b2dd341d8c req-4f002d81-4aac-439a-a886-65445e8b4fa2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352423 Sep 16 16:24:34.772915 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Attempting to bind port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:34.773402 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Attempting to bind port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:34.773633 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Attempting to bind port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 on network e657e2d9-d56a-46a2-987f-ea59605a973c {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:34.779984 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 24, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:34.780602 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Checking segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:34.780999 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.781541 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Bound using segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:34.782158 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Bound port: c4e418d2-30cd-4d01-a800-ebfcb06cd4b8, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:34.782724 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.851583 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] For port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:34.851828 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Allocated IP 172.27.3.220 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/b4a2eb44-3630-47cf-ae00-b6a88646b14d) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:34.854505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] For port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:34.859339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:34.918530 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1060b48f-dd2d-47cc-82d7-a53891c16b14 None None] Pushing event updated for resources: {'Port': ['ID=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:34.968935 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.002144 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.041737 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:35.044614 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:35.051589 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:35.055042 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Pushing event updated for resources: {'Port': ['ID=b4a2eb44-3630-47cf-ae00-b6a88646b14d,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:35.313967 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.500652 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.630751 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Router c5d486d8-21f8-44c3-970d-2255111128dd is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93950) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:24:35.731902 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f99f2a-fc6c-4d99-a42f-1c524f8db1fd req-a6cf291d-455e-4daf-b13e-d5e84310e958 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:35.741264 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-54f99f2a-fc6c-4d99-a42f-1c524f8db1fd req-a6cf291d-455e-4daf-b13e-d5e84310e958 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0869706 Sep 16 16:24:35.757443 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:24:35.758288 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:35.766498 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Sync routers for ids ['c5d486d8-21f8-44c3-970d-2255111128dd'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:24:35.783009 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Routers {'c5d486d8-21f8-44c3-970d-2255111128dd'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:35.783826 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['c5d486d8-21f8-44c3-970d-2255111128dd'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:35.796036 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-54f99f2a-fc6c-4d99-a42f-1c524f8db1fd req-fce76aab-0fa3-4b18-86bd-83efa3aaeee9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535994 Sep 16 16:24:35.801109 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.802537 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-fee30fe5-120c-4f18-86e4-1168f77718d8 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.5679939 Sep 16 16:24:35.805195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40068) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:35.845971 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:35.846429 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.921462 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Set router c5d486d8-21f8-44c3-970d-2255111128dd gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:35.929047 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b010016c-ae6e-4bfb-91b7-df2f07cbaa98 None None] Network e657e2d9-d56a-46a2-987f-ea59605a973c requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:24:35.966165 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:35.979042 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02d4045-2233-4777-8682-4bcaefb49f83 req-3c85f4c7-54ee-467e-bfbf-9d2ea25c46ff tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:35.980748 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b02d4045-2233-4777-8682-4bcaefb49f83 req-3c85f4c7-54ee-467e-bfbf-9d2ea25c46ff tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0982943 Sep 16 16:24:36.054221 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:36.062515 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-e5a5fffc-1582-4980-97bc-799a9de22117 None None] Provisioning complete for port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:36.062967 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e5a5fffc-1582-4980-97bc-799a9de22117 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.064575 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.068387 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b02d4045-2233-4777-8682-4bcaefb49f83 req-87ee639e-648d-4400-a9a5-9453c10d3917 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812991 Sep 16 16:24:36.117514 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:35Z', 'revision_number': 3, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:36.149127 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Checking router: c5d486d8-21f8-44c3-970d-2255111128dd for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:24:36.150304 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Updating router c5d486d8-21f8-44c3-970d-2255111128dd port b4a2eb44-3630-47cf-ae00-b6a88646b14d binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:24:36.175837 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.301447 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:36.446231 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.463030 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.510970 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Pushing event updated for resources: {'Port': ['ID=b4a2eb44-3630-47cf-ae00-b6a88646b14d,revision_number=2']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:36.518339 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.518709 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.519055 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.519415 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.519749 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.520074 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.520403 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.520725 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.521069 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.521400 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.521721 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.522038 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:24:36.532930 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.562608 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Attempting to bind port b4a2eb44-3630-47cf-ae00-b6a88646b14d on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:36.562798 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Attempting to bind port b4a2eb44-3630-47cf-ae00-b6a88646b14d by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:36.563163 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Attempting to bind port b4a2eb44-3630-47cf-ae00-b6a88646b14d on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:36.569139 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 24, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:36.569514 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:36.570108 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.570365 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:36.570886 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Bound port: b4a2eb44-3630-47cf-ae00-b6a88646b14d, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:36.572136 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.600605 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-fb62ac51-e1f9-40c5-a55f-6a6d0fbdc6e4 None None] Provisioning complete for port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:36.600986 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-fb62ac51-e1f9-40c5-a55f-6a6d0fbdc6e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.626827 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] For port b4a2eb44-3630-47cf-ae00-b6a88646b14d, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:36.630827 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] For port b4a2eb44-3630-47cf-ae00-b6a88646b14d, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=b4a2eb44-3630-47cf-ae00-b6a88646b14d,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:36.636262 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.693911 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7283b42-4d6b-454d-b1ef-2a8177d1db2c None None] Pushing event updated for resources: {'Port': ['ID=b4a2eb44-3630-47cf-ae00-b6a88646b14d,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:36.707621 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Routers {'c5d486d8-21f8-44c3-970d-2255111128dd'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:36.708228 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['c5d486d8-21f8-44c3-970d-2255111128dd'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:36.749204 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Allocated IP 172.20.0.1 (e657e2d9-d56a-46a2-987f-ea59605a973c/4b5db019-2ec2-4635-90ac-83301ff8e797/f410a660-bea0-4ae7-868b-9db8e0cc0c45) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:36.811948 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] Set router c5d486d8-21f8-44c3-970d-2255111128dd gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:36.854809 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.890499 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:36.921343 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3e9887-59be-47eb-a3c4-07d4c3061e93 req-1e87e158-36d5-482d-af54-b183356d9fa0 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:36.924390 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fa3e9887-59be-47eb-a3c4-07d4c3061e93 req-1e87e158-36d5-482d-af54-b183356d9fa0 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0562980 Sep 16 16:24:36.925857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device b1c52d5b-bbf5-41b4-8327-96f414326e65 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:24:36.940075 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Network e657e2d9-d56a-46a2-987f-ea59605a973c is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:36.945468 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:36.950425 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: b1c52d5b-bbf5-41b4-8327-96f414326e65 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:24:36.950889 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device b1c52d5b-bbf5-41b4-8327-96f414326e65 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:24:36.956302 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:36.981181 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fa3e9887-59be-47eb-a3c4-07d4c3061e93 req-7e4a5951-9516-42d5-a533-bb4534c068dd tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474780 Sep 16 16:24:37.005930 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Pushing event updated for resources: {'Port': ['ID=f410a660-bea0-4ae7-868b-9db8e0cc0c45,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:37.020011 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.091049 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:35Z', 'revision_number': 3, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:37.119837 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c92f243-5864-4484-8283-f8c66071a629 None None] The sync data for ids ['c5d486d8-21f8-44c3-970d-2255111128dd'] in dv-cinder-805887-15-iscsi is: [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:35Z', 'revision_number': 3, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:24:37.204509 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-82ba2730-388b-4d64-b759-a7c0be15b7a8 None None] Provisioning complete for port f410a660-bea0-4ae7-868b-9db8e0cc0c45 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:37.205377 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-82ba2730-388b-4d64-b759-a7c0be15b7a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.245894 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-82ba2730-388b-4d64-b759-a7c0be15b7a8 None None] Port f410a660-bea0-4ae7-868b-9db8e0cc0c45 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:24:37.278995 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813231bb-13f4-429e-9333-cd139b0c4127 req-473f5e30-fb44-4b0e-8ce3-cd00e711a343 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:37.280511 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-813231bb-13f4-429e-9333-cd139b0c4127 req-473f5e30-fb44-4b0e-8ce3-cd00e711a343 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0979166 Sep 16 16:24:37.288733 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.352962 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-813231bb-13f4-429e-9333-cd139b0c4127 req-bb9529be-c732-471b-9125-324021754e6b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654609 Sep 16 16:24:37.527288 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.533524 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.601334 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Pushing event updated for resources: {'Port': ['ID=f410a660-bea0-4ae7-868b-9db8e0cc0c45,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:37.605232 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.708064 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Network e657e2d9-d56a-46a2-987f-ea59605a973c is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:37.709755 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:37.808258 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device b4a2eb44-3630-47cf-ae00-b6a88646b14d up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:37.842524 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Router c5d486d8-21f8-44c3-970d-2255111128dd has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:24:37.871290 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port b4a2eb44-3630-47cf-ae00-b6a88646b14d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:37.871663 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.966472 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:37.967092 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:24:37.973047 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-6cd850df-a93c-4d80-9dcf-8985b663263e admin admin] 10.222.0.59 "PUT /v2.0/routers/c5d486d8-21f8-44c3-970d-2255111128dd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1661830 Sep 16 16:24:37.993590 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port b4a2eb44-3630-47cf-ae00-b6a88646b14d, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=b4a2eb44-3630-47cf-ae00-b6a88646b14d,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:37.995241 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-118d306e-22d9-4154-aa81-459f4a8a7d07 None None] Provisioning complete for port f410a660-bea0-4ae7-868b-9db8e0cc0c45 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:37.995613 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-118d306e-22d9-4154-aa81-459f4a8a7d07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.021194 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.022106 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:38.104166 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-118d306e-22d9-4154-aa81-459f4a8a7d07 None None] Port f410a660-bea0-4ae7-868b-9db8e0cc0c45 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:24:38.137578 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=b4a2eb44-3630-47cf-ae00-b6a88646b14d,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:38.154557 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:38.155283 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.169215 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aceaf367-e59b-4b6d-bda2-b8882150b0b8 req-b848902c-ff23-4e65-ae99-18d6c4b99614 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:38.171061 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-aceaf367-e59b-4b6d-bda2-b8882150b0b8 req-b848902c-ff23-4e65-ae99-18d6c4b99614 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0754154 Sep 16 16:24:38.244945 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-aceaf367-e59b-4b6d-bda2-b8882150b0b8 req-83308542-bf6f-4281-94a8-1229e12228f6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0651405 Sep 16 16:24:38.483109 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b91989-f535-451e-8955-4ad72d44063d req-3e68fca4-45a2-412b-b92a-a868c5dc8f6c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:38.485342 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f8b91989-f535-451e-8955-4ad72d44063d req-3e68fca4-45a2-412b-b92a-a868c5dc8f6c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0514619 Sep 16 16:24:38.569810 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f8b91989-f535-451e-8955-4ad72d44063d req-f679e72b-bec4-40b2-9dd6-073c4b3c9755 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773242 Sep 16 16:24:38.614584 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40126) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:38.625373 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1788779694-network', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:38.661476 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Made reservation on behalf of 0f9054205aaa4371b1152f904e9babc9 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:24:38.664283 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.674155 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.843982 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.853656 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.893543 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=172a0620-3a65-4a8c-a5a3-ebdc52521444,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:38.908338 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 732} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:24:38.925820 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:38.926395 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Added segment f2607963-ecb2-42f2-9eb9-7c4ad174c81c of type vlan for network a7e04255-5ffc-4690-9fd6-cd627067ded5 Sep 16 16:24:38.980646 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.003675 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Sync routers for ids ['c5d486d8-21f8-44c3-970d-2255111128dd'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:24:39.013759 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Routers {'c5d486d8-21f8-44c3-970d-2255111128dd'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:39.014383 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['c5d486d8-21f8-44c3-970d-2255111128dd'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:39.014544 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.015954 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:39.016925 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.053384 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4374945 Sep 16 16:24:39.056199 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40138) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:39.063578 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Request body: {'subnet': {'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1788779694-subnet', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:39.150488 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7704cdb4-9344-4641-a48e-7550242037b0 admin admin] Pushing event updated for resources: {'Network': ['ID=a7e04255-5ffc-4690-9fd6-cd627067ded5,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:39.163744 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:24:39.172378 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Made reservation on behalf of 0f9054205aaa4371b1152f904e9babc9 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:24:39.176863 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64151728'] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.213943 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Set router c5d486d8-21f8-44c3-970d-2255111128dd gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:39.431461 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd11205-aa70-4060-b81e-77f3511d7c5e req-70cb146e-1777-4239-87da-0fe31f962dc2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:39.435653 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cdd11205-aa70-4060-b81e-77f3511d7c5e req-70cb146e-1777-4239-87da-0fe31f962dc2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0873830 Sep 16 16:24:39.483195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-65205906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64151710'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.508674 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cdd11205-aa70-4060-b81e-77f3511d7c5e req-3e60d342-09ad-44b2-8a1c-119d6582b4c6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0655634 Sep 16 16:24:39.534933 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b39c2db-aa23-4957-a338-6296fbf4b9ef,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:39.537862 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f410a660-bea0-4ae7-868b-9db8e0cc0c45', 'name': '', 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c', 'tenant_id': '3320c65285f54af487d03b845f596772', 'mac_address': 'fa:16:3e:cc:94:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '4b5db019-2ec2-4635-90ac-83301ff8e797', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:36Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 2, 'project_id': '3320c65285f54af487d03b845f596772', 'subnets': [{'id': '4b5db019-2ec2-4635-90ac-83301ff8e797', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:39.571834 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Checking router: c5d486d8-21f8-44c3-970d-2255111128dd for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:24:39.572173 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Updating router c5d486d8-21f8-44c3-970d-2255111128dd port f410a660-bea0-4ae7-868b-9db8e0cc0c45 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:24:39.575092 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Checking segment: {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:39.575679 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Network hostable DHCP agents. Network: a7e04255-5ffc-4690-9fd6-cd627067ded5, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:24:39.615587 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:24:39.627021 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.631995 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, a7e04255-5ffc-4690-9fd6-cd627067ded5) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:39.641246 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:39.642097 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.651671 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a58fffe-1095-4095-8420-0f072b6bf967 None None] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:24:39.716760 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-59b7fd93-62da-40ed-bbf7-bc0c40dfedd7 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6571109 Sep 16 16:24:39.717134 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40146) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:39.727832 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:39.751473 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fc4dd7-b1b5-4842-95c0-7af32b09c142 req-9f2be0ac-2514-4c52-af4a-7be2a869a0ad tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:39.753194 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-41fc4dd7-b1b5-4842-95c0-7af32b09c142 req-9f2be0ac-2514-4c52-af4a-7be2a869a0ad tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1082325 Sep 16 16:24:39.756004 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.757258 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.807914 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-41fc4dd7-b1b5-4842-95c0-7af32b09c142 req-a0107c48-ff19-4a81-8797-504fa5c4e2f3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472629 Sep 16 16:24:39.814101 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:39.947249 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device b4a2eb44-3630-47cf-ae00-b6a88646b14d up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:40.011335 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.114370 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-a7e04255-5ffc-4690-9fd6-cd627067ded5', 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'fixed_ips': [{'subnet_id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:24:40.115229 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.129374 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port b4a2eb44-3630-47cf-ae00-b6a88646b14d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:40.130187 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.295559 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.296430 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.329198 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.384777 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Allocated IP 172.20.0.2 (a7e04255-5ffc-4690-9fd6-cd627067ded5/4b39c2db-aa23-4957-a338-6296fbf4b9ef/d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:40.421381 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.573775 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Allocated IP 172.27.3.9 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/27df033d-1cce-4324-9959-3c38ee56e896) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:40.694755 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be50c7a-5cb8-45df-804b-59f7e790fc2e req-2561a6d9-daa5-4fa3-8211-aed0389259de tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:40.703759 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7be50c7a-5cb8-45df-804b-59f7e790fc2e req-2561a6d9-daa5-4fa3-8211-aed0389259de tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0951419 Sep 16 16:24:40.761191 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7be50c7a-5cb8-45df-804b-59f7e790fc2e req-36f8f80d-7021-4a29-b4cb-06fb9e25998f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561829 Sep 16 16:24:40.765485 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd21cb8-777c-48b6-af06-0a65f84d9b08 None None] Pushing event updated for resources: {'Port': ['ID=f410a660-bea0-4ae7-868b-9db8e0cc0c45,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:40.771637 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.807845 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.849728 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:40.854153 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:40.857519 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:40.871020 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Attempting to bind port f410a660-bea0-4ae7-868b-9db8e0cc0c45 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:40.871408 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Attempting to bind port f410a660-bea0-4ae7-868b-9db8e0cc0c45 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:40.871768 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Attempting to bind port f410a660-bea0-4ae7-868b-9db8e0cc0c45 on network e657e2d9-d56a-46a2-987f-ea59605a973c {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:40.884430 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Pushing event updated for resources: {'Port': ['ID=27df033d-1cce-4324-9959-3c38ee56e896,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:40.890857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 24, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:40.891382 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Checking segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:40.891771 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.892018 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Bound using segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:40.892488 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Bound port: f410a660-bea0-4ae7-868b-9db8e0cc0c45, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:40.892904 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.905803 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.911429 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-4134bd1a-b56f-41db-85d2-bb852b9ab890 None None] Provisioning complete for port f410a660-bea0-4ae7-868b-9db8e0cc0c45 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:40.911524 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4134bd1a-b56f-41db-85d2-bb852b9ab890 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:40.950462 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.012951 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:41.019673 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-4134bd1a-b56f-41db-85d2-bb852b9ab890 None None] Port f410a660-bea0-4ae7-868b-9db8e0cc0c45 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:24:41.027936 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:41.034451 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:41.046485 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] For port f410a660-bea0-4ae7-868b-9db8e0cc0c45, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:41.048792 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Pushing event updated for resources: {'Port': ['ID=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:41.052321 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] For port f410a660-bea0-4ae7-868b-9db8e0cc0c45, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=f410a660-bea0-4ae7-868b-9db8e0cc0c45,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:41.074575 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.083731 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6881bf2e-d278-4b48-850a-b35fb1336b58 req-bc261963-8598-4233-aebf-c141eeba1d16 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:41.085209 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6881bf2e-d278-4b48-850a-b35fb1336b58 req-bc261963-8598-4233-aebf-c141eeba1d16 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1129317 Sep 16 16:24:41.145475 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Attempting to bind port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:41.146007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Attempting to bind port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:41.146007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Attempting to bind port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a on network a7e04255-5ffc-4690-9fd6-cd627067ded5 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:41.161931 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 24, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:41.162334 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Checking segment: {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:41.162703 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.163127 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Bound using segment: {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:41.163602 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Bound port: d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:41.163983 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.175691 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd21cb8-777c-48b6-af06-0a65f84d9b08 None None] Pushing event updated for resources: {'Port': ['ID=f410a660-bea0-4ae7-868b-9db8e0cc0c45,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:41.181186 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Routers {'c5d486d8-21f8-44c3-970d-2255111128dd'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:41.182031 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['c5d486d8-21f8-44c3-970d-2255111128dd'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:41.189559 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6881bf2e-d278-4b48-850a-b35fb1336b58 req-120fa862-2b55-4daf-ab69-6ee3ce158d47 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974369 Sep 16 16:24:41.195744 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.347690 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] For port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:41.362093 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] Set router c5d486d8-21f8-44c3-970d-2255111128dd gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:41.390196 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] For port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:41.401874 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.459697 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.539604 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-f3a1c24b-2af5-44a9-85b5-6f40711c8b3e None None] Provisioning complete for port f410a660-bea0-4ae7-868b-9db8e0cc0c45 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:41.539604 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f3a1c24b-2af5-44a9-85b5-6f40711c8b3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.542855 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfa6a25-4b2e-4225-9a3b-b39d2499d2e6 None None] Pushing event updated for resources: {'Port': ['ID=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:41.660790 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Router 0f4d2d64-e8e8-4901-b561-086787991683 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93951) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:24:41.823455 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f3a1c24b-2af5-44a9-85b5-6f40711c8b3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.917595 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-f3a1c24b-2af5-44a9-85b5-6f40711c8b3e None None] For port f410a660-bea0-4ae7-868b-9db8e0cc0c45, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=f410a660-bea0-4ae7-868b-9db8e0cc0c45,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:41.926635 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f410a660-bea0-4ae7-868b-9db8e0cc0c45', 'name': '', 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c', 'tenant_id': '3320c65285f54af487d03b845f596772', 'mac_address': 'fa:16:3e:cc:94:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '4b5db019-2ec2-4635-90ac-83301ff8e797', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:36Z', 'updated_at': '2021-09-16T16:24:41Z', 'revision_number': 4, 'project_id': '3320c65285f54af487d03b845f596772', 'subnets': [{'id': '4b5db019-2ec2-4635-90ac-83301ff8e797', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:41.982989 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f3a1c24b-2af5-44a9-85b5-6f40711c8b3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:41.996029 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af78bb0b-bf0b-4f02-a839-575f15275533 None None] The sync data for ids ['c5d486d8-21f8-44c3-970d-2255111128dd'] in dv-cinder-805887-15-iscsi is: [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f410a660-bea0-4ae7-868b-9db8e0cc0c45', 'name': '', 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c', 'tenant_id': '3320c65285f54af487d03b845f596772', 'mac_address': 'fa:16:3e:cc:94:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 438, 'fixed_ips': [{'subnet_id': '4b5db019-2ec2-4635-90ac-83301ff8e797', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:36Z', 'updated_at': '2021-09-16T16:24:41Z', 'revision_number': 4, 'project_id': '3320c65285f54af487d03b845f596772', 'subnets': [{'id': '4b5db019-2ec2-4635-90ac-83301ff8e797', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:24:42.001525 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a723e7bb-2ce5-4007-917c-7c88dee5c759 req-7a0e8820-5fdb-42b7-8e05-c80e7fca7e59 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:42.013970 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a723e7bb-2ce5-4007-917c-7c88dee5c759 req-7a0e8820-5fdb-42b7-8e05-c80e7fca7e59 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0960736 Sep 16 16:24:42.091343 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a1c24b-2af5-44a9-85b5-6f40711c8b3e None None] Pushing event updated for resources: {'Port': ['ID=f410a660-bea0-4ae7-868b-9db8e0cc0c45,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:42.115611 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a723e7bb-2ce5-4007-917c-7c88dee5c759 req-5ac46c47-30e2-44d5-b46f-cfebb15763e9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1002736 Sep 16 16:24:42.152058 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:24:42.162672 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Sync routers for ids ['0f4d2d64-e8e8-4901-b561-086787991683'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:24:42.178986 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:42.179759 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Routers {'0f4d2d64-e8e8-4901-b561-086787991683'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:42.180513 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['0f4d2d64-e8e8-4901-b561-086787991683'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:42.183614 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40182) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:42.184193 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f0ac21b2-646b-4e1c-8e07-504d279d6cbc admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.4652910 Sep 16 16:24:42.402272 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Set router 0f4d2d64-e8e8-4901-b561-086787991683 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:42.419766 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb5960a-2d8a-4ffb-ba67-e6cbb08c7b71 req-ca1dbdce-d6ad-461f-8d27-803bf91a3cc1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:42.421898 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7fb5960a-2d8a-4ffb-ba67-e6cbb08c7b71 req-ca1dbdce-d6ad-461f-8d27-803bf91a3cc1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1006641 Sep 16 16:24:42.482284 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7fb5960a-2d8a-4ffb-ba67-e6cbb08c7b71 req-79520aab-2419-452f-829d-df818dd71b6e tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528553 Sep 16 16:24:42.847393 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:24:41Z', 'revision_number': 3, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:42.888330 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Checking router: 0f4d2d64-e8e8-4901-b561-086787991683 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:24:42.889011 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Updating router 0f4d2d64-e8e8-4901-b561-086787991683 port 27df033d-1cce-4324-9959-3c38ee56e896 binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:24:42.924123 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.063703 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf5dc569-0cfb-44ad-a5bc-c3a360ef8f77 None None] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:24:43.291924 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-50b4b065-119b-44e7-aee5-dea7e4d68ff4 None None] Provisioning complete for port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:43.292761 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-50b4b065-119b-44e7-aee5-dea7e4d68ff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.392637 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.405731 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.461795 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d10d14-c7d2-43b1-9419-e665037acfe5 None None] Pushing event updated for resources: {'Port': ['ID=27df033d-1cce-4324-9959-3c38ee56e896,revision_number=2']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:43.506735 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Attempting to bind port 27df033d-1cce-4324-9959-3c38ee56e896 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:43.507102 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Attempting to bind port 27df033d-1cce-4324-9959-3c38ee56e896 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:43.507426 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Attempting to bind port 27df033d-1cce-4324-9959-3c38ee56e896 on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:43.518293 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 24, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:43.522701 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:43.523363 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.523910 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:43.526122 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Bound port: 27df033d-1cce-4324-9959-3c38ee56e896, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:43.532460 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.539061 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-50b4b065-119b-44e7-aee5-dea7e4d68ff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.569335 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789132d3-2882-4d41-913f-de1db57f5ee7 req-c8065720-9ea5-4072-953e-cea847ecae23 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:43.571006 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-789132d3-2882-4d41-913f-de1db57f5ee7 req-c8065720-9ea5-4072-953e-cea847ecae23 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.2597671 Sep 16 16:24:43.613890 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-50b4b065-119b-44e7-aee5-dea7e4d68ff4 None None] For port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:43.625136 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-50b4b065-119b-44e7-aee5-dea7e4d68ff4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.655104 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-789132d3-2882-4d41-913f-de1db57f5ee7 req-c4ac5286-9942-478f-bac4-3d2ee9e68e9f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0766494 Sep 16 16:24:43.724261 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b2d0e0-dfc9-4618-9be5-38da2e3102ef req-7ecf7397-9558-47df-a8a7-34187a422683 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:43.727069 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-21b2d0e0-dfc9-4618-9be5-38da2e3102ef req-7ecf7397-9558-47df-a8a7-34187a422683 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1299002 Sep 16 16:24:43.755653 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.794136 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] For port 27df033d-1cce-4324-9959-3c38ee56e896, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:43.809957 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b4b065-119b-44e7-aee5-dea7e4d68ff4 None None] Pushing event updated for resources: {'Port': ['ID=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:43.813216 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-21b2d0e0-dfc9-4618-9be5-38da2e3102ef req-f1810024-c8e1-46d1-bed4-051ab3c80095 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711081 Sep 16 16:24:43.824388 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] For port 27df033d-1cce-4324-9959-3c38ee56e896, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=27df033d-1cce-4324-9959-3c38ee56e896,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:43.841169 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:43.956590 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Routers {'0f4d2d64-e8e8-4901-b561-086787991683'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:43.957622 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['0f4d2d64-e8e8-4901-b561-086787991683'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:43.974137 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a328ea40-62a4-4e7c-a2f4-efc09d1e9925 None None] Provisioning complete for port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:43.976959 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a328ea40-62a4-4e7c-a2f4-efc09d1e9925 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.046644 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f410a660-bea0-4ae7-868b-9db8e0cc0c45 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:44.068054 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d10d14-c7d2-43b1-9419-e665037acfe5 None None] Pushing event updated for resources: {'Port': ['ID=27df033d-1cce-4324-9959-3c38ee56e896,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:44.137116 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Allocated IP 172.20.0.1 (a7e04255-5ffc-4690-9fd6-cd627067ded5/4b39c2db-aa23-4957-a338-6296fbf4b9ef/e2f6098f-dbf8-43d1-8c87-d108a4fb3884) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:24:44.158339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port f410a660-bea0-4ae7-868b-9db8e0cc0c45 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:44.158928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.238827 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] Set router 0f4d2d64-e8e8-4901-b561-086787991683 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:44.289278 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.308567 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505c7379-a11b-494a-bc2e-e708dce9bf5f req-0c0134f4-6b31-44a8-8be8-9667f57f10e6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:44.316202 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-505c7379-a11b-494a-bc2e-e708dce9bf5f req-0c0134f4-6b31-44a8-8be8-9667f57f10e6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.1025205 Sep 16 16:24:44.349132 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.399885 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-505c7379-a11b-494a-bc2e-e708dce9bf5f req-361a449a-5b57-4b81-ad49-f73a48c78235 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826495 Sep 16 16:24:44.409817 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:44.418756 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:44.421167 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Pushing event updated for resources: {'Port': ['ID=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:44.423496 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:24:44.427017 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:44.483271 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:24:41Z', 'revision_number': 3, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:44.485027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.491871 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:44.492501 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.536605 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad79f61-b530-438e-870e-dc2aebceaad1 None None] The sync data for ids ['0f4d2d64-e8e8-4901-b561-086787991683'] in dv-cinder-805887-15-iscsi is: [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:24:41Z', 'revision_number': 3, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:24:44.740673 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.819368 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-4c0b901d-30cd-4786-bca7-9f809e6040af None None] Provisioning complete for port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:44.819368 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4c0b901d-30cd-4786-bca7-9f809e6040af None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:44.859504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-4c0b901d-30cd-4786-bca7-9f809e6040af None None] Port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:24:44.872954 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6245a5d-d899-457b-92f7-2f4a4d18fc4d req-574a9c89-8f47-4c1f-b216-7e1f0cd50918 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:44.874629 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a6245a5d-d899-457b-92f7-2f4a4d18fc4d req-574a9c89-8f47-4c1f-b216-7e1f0cd50918 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.1106572 Sep 16 16:24:44.997778 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af14da2c-1a69-4f59-9cfc-7e1bea3fb477 req-e10fef61-dcfc-402a-a556-31a6bd2b44b5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:45.005998 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-af14da2c-1a69-4f59-9cfc-7e1bea3fb477 req-e10fef61-dcfc-402a-a556-31a6bd2b44b5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0741315 Sep 16 16:24:45.037403 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a6245a5d-d899-457b-92f7-2f4a4d18fc4d req-e624ab3d-ceeb-4f69-a825-1d3cda7d6709 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1469843 Sep 16 16:24:45.088874 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-af14da2c-1a69-4f59-9cfc-7e1bea3fb477 req-ba1cd724-b258-4040-9c1c-f206be7a3541 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740569 Sep 16 16:24:45.094014 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:45.104628 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:45.175807 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Pushing event updated for resources: {'Port': ['ID=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:45.200854 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:45.320102 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:24:45.321815 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:24:45.542164 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Router 0f4d2d64-e8e8-4901-b561-086787991683 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:24:45.578832 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c94ce7-bdd8-475f-ac49-c23be159ee53 req-36779771-eeb9-4d11-8d71-dcc13042885c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:45.584597 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-83c94ce7-bdd8-475f-ac49-c23be159ee53 req-36779771-eeb9-4d11-8d71-dcc13042885c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.0982144 Sep 16 16:24:45.723138 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:45.735265 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-ef4d9ad0-a48f-41ef-8810-f11a687cf524 None None] Provisioning complete for port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:45.735265 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ef4d9ad0-a48f-41ef-8810-f11a687cf524 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:45.761535 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-83c94ce7-bdd8-475f-ac49-c23be159ee53 req-33904069-80d4-4b0d-90eb-9b06861f653b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1331773 Sep 16 16:24:45.779824 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-ef4d9ad0-a48f-41ef-8810-f11a687cf524 None None] Port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:24:45.799533 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:24:45.810158 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-8f9f40c6-53dd-4fb3-b45f-15407eb80c45 admin admin] 10.222.0.59 "PUT /v2.0/routers/0f4d2d64-e8e8-4901-b561-086787991683/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6248367 Sep 16 16:24:45.878602 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:45.936666 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:45.937071 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:46.056547 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 27df033d-1cce-4324-9959-3c38ee56e896 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:46.132379 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 27df033d-1cce-4324-9959-3c38ee56e896 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:46.132799 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:46.219807 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb26c7b5-14a5-433b-9f90-2c67c3b7120b req-e74ff139-41e6-4182-8e25-61245f73e26d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:46.227419 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bb26c7b5-14a5-433b-9f90-2c67c3b7120b req-e74ff139-41e6-4182-8e25-61245f73e26d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0716469 Sep 16 16:24:46.296918 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:46.327672 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bb26c7b5-14a5-433b-9f90-2c67c3b7120b req-ed4559e7-70f3-479b-a838-77986b5e0d7c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0993443 Sep 16 16:24:46.329346 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 27df033d-1cce-4324-9959-3c38ee56e896, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=27df033d-1cce-4324-9959-3c38ee56e896,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:46.343489 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:46.428510 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=27df033d-1cce-4324-9959-3c38ee56e896,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:46.460540 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699c1d7d-1124-4a21-ba74-52f145141db7 req-4be01165-f72a-4bcf-863e-7e887333b350 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:46.469365 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-699c1d7d-1124-4a21-ba74-52f145141db7 req-4be01165-f72a-4bcf-863e-7e887333b350 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0612314 Sep 16 16:24:46.509555 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-699c1d7d-1124-4a21-ba74-52f145141db7 req-835c822c-83de-46b2-9809-481bb57b363d tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391734 Sep 16 16:24:46.746231 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Sync routers for ids ['0f4d2d64-e8e8-4901-b561-086787991683'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:24:46.763343 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Routers {'0f4d2d64-e8e8-4901-b561-086787991683'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:46.764283 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['0f4d2d64-e8e8-4901-b561-086787991683'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:46.797130 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9d94af-a836-4483-939a-b5f74b028006 req-80293bce-f32b-49e4-b37f-6a5c73afb06b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:46.800349 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0f9d94af-a836-4483-939a-b5f74b028006 req-80293bce-f32b-49e4-b37f-6a5c73afb06b service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0498130 Sep 16 16:24:46.868957 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0f9d94af-a836-4483-939a-b5f74b028006 req-4264ad9e-4080-4c61-9d2c-47ec2b477516 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592902 Sep 16 16:24:46.926615 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40252) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:46.933060 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1140710657', 'description': 'tempest-secgroup-smoke-1140710657 description', 'project_id': '3320c65285f54af487d03b845f596772'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:46.942928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Set router 0f4d2d64-e8e8-4901-b561-086787991683 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:46.962848 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:46.967330 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3557d421-4872-47a1-8b10-0aaa32f29cc0 req-c830367b-0661-445f-a59c-0632373c5a21 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:46.974878 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3557d421-4872-47a1-8b10-0aaa32f29cc0 req-c830367b-0661-445f-a59c-0632373c5a21 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.1077476 Sep 16 16:24:47.018010 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3557d421-4872-47a1-8b10-0aaa32f29cc0 req-4362c715-847e-42fc-805e-34085581c90c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421495 Sep 16 16:24:47.084237 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.090824 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.126999 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.128686 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2005975 Sep 16 16:24:47.131671 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40256) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:47.138564 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group_rule': {'security_group_id': '55cbc262-276f-4921-8e64-cd4fecacadec', 'project_id': '3320c65285f54af487d03b845f596772', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:47.160343 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02534c4f-ec23-4065-81d6-cb24ccecb7eb tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroup': ['ID=55cbc262-276f-4921-8e64-cd4fecacadec,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:47.221754 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.223733 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:24:44Z', 'revision_number': 4, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'e2f6098f-dbf8-43d1-8c87-d108a4fb3884', 'name': '', 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'mac_address': 'fa:16:3e:d1:08:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_interface', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:43Z', 'updated_at': '2021-09-16T16:24:44Z', 'revision_number': 2, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'subnets': [{'id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:47.251289 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Checking router: 0f4d2d64-e8e8-4901-b561-086787991683 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:24:47.251809 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Updating router 0f4d2d64-e8e8-4901-b561-086787991683 port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:24:47.281377 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.309594 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.314872 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.341202 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c57f0c9-6538-4012-981b-739922265e2d,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:47.361683 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.363099 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-81ecff0b-4a00-41ad-a0b5-7d436a1c36bf tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2288804 Sep 16 16:24:47.365864 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40262) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:47.371027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group_rule': {'security_group_id': '55cbc262-276f-4921-8e64-cd4fecacadec', 'project_id': '3320c65285f54af487d03b845f596772', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:47.403334 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.468395 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfaa9408-5f5c-481d-a106-bed1dbabb31e req-4dca9086-8366-45e4-b531-4e72a3c24fb3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:47.477770 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cfaa9408-5f5c-481d-a106-bed1dbabb31e req-4dca9086-8366-45e4-b531-4e72a3c24fb3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0649462 Sep 16 16:24:47.487902 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.497173 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.517010 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cfaa9408-5f5c-481d-a106-bed1dbabb31e req-419de9cc-b1c4-4ad0-8263-58f44b9f30be tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377159 Sep 16 16:24:47.523687 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f32353cf-c0d3-4292-b279-b4ad40fcbace,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:47.534834 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.539466 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-611be1b4-a925-4217-983d-d502e686f39b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1725304 Sep 16 16:24:47.539677 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40266) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:47.544095 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group_rule': {'security_group_id': '55cbc262-276f-4921-8e64-cd4fecacadec', 'project_id': '3320c65285f54af487d03b845f596772', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:47.591670 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.666303 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39ffa34-2c56-487d-98c9-fef5113415fc req-7819ba9c-d855-41fb-aa47-421fcfc064bc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:47.667863 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e39ffa34-2c56-487d-98c9-fef5113415fc req-7819ba9c-d855-41fb-aa47-421fcfc064bc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0704637 Sep 16 16:24:47.708569 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.722438 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.729537 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.734475 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.764595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f096517c-fab4-4ee2-91fd-7286228fa3d5,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:47.770746 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e39ffa34-2c56-487d-98c9-fef5113415fc req-849c043e-3743-4006-9e3c-3ff84dc784fc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964017 Sep 16 16:24:47.792502 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.793607 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 27df033d-1cce-4324-9959-3c38ee56e896 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:47.796570 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40272) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:47.796719 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-cd7b90c7-7f05-45f5-b662-6229a154c91c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2560406 Sep 16 16:24:47.801128 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group_rule': {'security_group_id': '55cbc262-276f-4921-8e64-cd4fecacadec', 'project_id': '3320c65285f54af487d03b845f596772', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:47.853392 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.958265 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:47.962679 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa8246d-eca5-4893-a7d3-50f32ecd89d1 None None] Pushing event updated for resources: {'Port': ['ID=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:47.966292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.004725 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Attempting to bind port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:24:48.005087 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Attempting to bind port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:24:48.005452 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Attempting to bind port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 on network a7e04255-5ffc-4690-9fd6-cd627067ded5 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:24:48.009639 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e89bcaa-6e34-4ce8-9672-f8722d45af76,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:48.019283 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.023013 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-69424d06-6bdb-41a3-aaea-937ad1fa4810 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2229080 Sep 16 16:24:48.023241 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40276) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:48.029022 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group_rule': {'security_group_id': '55cbc262-276f-4921-8e64-cd4fecacadec', 'project_id': '3320c65285f54af487d03b845f596772', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:48.060992 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 24, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:24:48.066337 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Checking segment: {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:24:48.068217 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.068827 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Bound using segment: {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:24:48.071351 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Bound port: e2f6098f-dbf8-43d1-8c87-d108a4fb3884, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 732, 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:24:48.073605 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.103018 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 27df033d-1cce-4324-9959-3c38ee56e896 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:48.103444 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.122992 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.securitygroups_db [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Project 3320c65285f54af487d03b845f596772 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 16 16:24:48.129561 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.197405 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-c18c1b04-ca84-4a44-82b8-339ee3905b0f None None] Provisioning complete for port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:48.197777 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c18c1b04-ca84-4a44-82b8-339ee3905b0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.205505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] For port e2f6098f-dbf8-43d1-8c87-d108a4fb3884, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:24:48.217052 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] For port e2f6098f-dbf8-43d1-8c87-d108a4fb3884, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:24:48.221522 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.232439 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.244411 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.257838 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c66d59b6-c596-4769-ad87-f9bef58c287d,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:48.280322 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d018335-ea9c-42a6-b076-47a080cc0124 req-c0e093d0-abee-4022-96a4-c18c2ea890c4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:48.284475 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.288098 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9d018335-ea9c-42a6-b076-47a080cc0124 req-c0e093d0-abee-4022-96a4-c18c2ea890c4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.1242409 Sep 16 16:24:48.288268 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-6442942f-cc62-4e06-9af3-b656e2870b04 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2606473 Sep 16 16:24:48.290533 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40284) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:24:48.305817 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-c18c1b04-ca84-4a44-82b8-339ee3905b0f None None] Port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:24:48.360589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'security_group_rule': {'security_group_id': '55cbc262-276f-4921-8e64-cd4fecacadec', 'project_id': '3320c65285f54af487d03b845f596772', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:24:48.365031 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa8246d-eca5-4893-a7d3-50f32ecd89d1 None None] Pushing event updated for resources: {'Port': ['ID=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:48.367661 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Routers {'0f4d2d64-e8e8-4901-b561-086787991683'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:24:48.368295 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['0f4d2d64-e8e8-4901-b561-086787991683'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:48.525433 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.securitygroups_db [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Project 3320c65285f54af487d03b845f596772 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 16 16:24:48.554824 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.576915 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] Set router 0f4d2d64-e8e8-4901-b561-086787991683 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:24:48.579971 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9d018335-ea9c-42a6-b076-47a080cc0124 req-49701808-2749-4d5b-a98c-97a7ac865275 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1944857 Sep 16 16:24:48.726728 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.732364 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.748589 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5affd366-5bae-4a63-923d-2dd9f04af3e6 req-e1b36aae-32af-4ad4-8a0f-565bf008dd44 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:48.750538 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5affd366-5bae-4a63-923d-2dd9f04af3e6 req-e1b36aae-32af-4ad4-8a0f-565bf008dd44 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0957668 Sep 16 16:24:48.753475 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e8407786-a921-4d97-b0af-656486695071,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:48.761160 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.762906 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-039edb22-b9c8-4e17-8e8d-0c1172cfb70e tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4702380 Sep 16 16:24:48.813837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-0dc6d45b-b7d7-4134-9a5f-711c7962bb36 None None] Provisioning complete for port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:48.814447 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0dc6d45b-b7d7-4134-9a5f-711c7962bb36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:48.816650 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5affd366-5bae-4a63-923d-2dd9f04af3e6 req-2c0d8647-31da-4e27-a466-b4b5edfe9769 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457525 Sep 16 16:24:48.949721 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a8bc9f-e60a-44b3-9d76-2d1a8b07edda req-aa8ddd4e-5d44-4be9-bf11-cd1a943b8da9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:48.953289 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-53a8bc9f-e60a-44b3-9d76-2d1a8b07edda req-aa8ddd4e-5d44-4be9-bf11-cd1a943b8da9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0947790 Sep 16 16:24:49.006173 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-53a8bc9f-e60a-44b3-9d76-2d1a8b07edda req-05f25ecb-3a49-455f-bdf5-b1d65ba6925f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424852 Sep 16 16:24:49.026275 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0dc6d45b-b7d7-4134-9a5f-711c7962bb36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:49.089726 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:24:44Z', 'revision_number': 4, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'e2f6098f-dbf8-43d1-8c87-d108a4fb3884', 'name': '', 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'mac_address': 'fa:16:3e:d1:08:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_interface', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:43Z', 'updated_at': '2021-09-16T16:24:48Z', 'revision_number': 4, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'subnets': [{'id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:24:49.121924 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-0dc6d45b-b7d7-4134-9a5f-711c7962bb36 None None] For port e2f6098f-dbf8-43d1-8c87-d108a4fb3884, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:49.123128 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d40bbbd-1c95-47d7-87dd-5ca989e9e3d7 None None] The sync data for ids ['0f4d2d64-e8e8-4901-b561-086787991683'] in dv-cinder-805887-15-iscsi is: [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:24:44Z', 'revision_number': 4, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'e2f6098f-dbf8-43d1-8c87-d108a4fb3884', 'name': '', 'network_id': 'a7e04255-5ffc-4690-9fd6-cd627067ded5', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'mac_address': 'fa:16:3e:d1:08:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_interface', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:43Z', 'updated_at': '2021-09-16T16:24:48Z', 'revision_number': 4, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'subnets': [{'id': '4b39c2db-aa23-4957-a338-6296fbf4b9ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:24:49.137077 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0dc6d45b-b7d7-4134-9a5f-711c7962bb36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:49.241303 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc6d45b-b7d7-4134-9a5f-711c7962bb36 None None] Pushing event updated for resources: {'Port': ['ID=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:49.681089 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb594503-604c-40e9-9527-208518f0e091 req-dd049402-452a-4d28-9208-a0d14d6a800b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:49.690437 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bb594503-604c-40e9-9527-208518f0e091 req-dd049402-452a-4d28-9208-a0d14d6a800b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0647449 Sep 16 16:24:49.738382 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bb594503-604c-40e9-9527-208518f0e091 req-123bfbb4-c247-4cb7-910a-8fdbce9955fa tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455050 Sep 16 16:24:49.809293 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device e2f6098f-dbf8-43d1-8c87-d108a4fb3884 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:24:49.828033 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0961c0e9-43b2-46b6-919f-20cc6e903d2b req-4b62c17c-f870-4caa-bc80-74bc49a8e7fa tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:49.830214 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0961c0e9-43b2-46b6-919f-20cc6e903d2b req-4b62c17c-f870-4caa-bc80-74bc49a8e7fa tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.1078346 Sep 16 16:24:49.882974 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:24:49.884154 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:49.962087 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0961c0e9-43b2-46b6-919f-20cc6e903d2b req-24f7428f-cddc-457a-8e6b-ad6384f92ae0 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1171250 Sep 16 16:24:50.003006 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b7ec375-5de2-4195-94f0-db71c17fde55 req-2e3ffdde-8ea3-4237-9245-445098e3ee4d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:50.004524 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2b7ec375-5de2-4195-94f0-db71c17fde55 req-2e3ffdde-8ea3-4237-9245-445098e3ee4d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0677333 Sep 16 16:24:50.043282 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2b7ec375-5de2-4195-94f0-db71c17fde55 req-c08678e7-59ad-4d52-82af-7940781c7510 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0322061 Sep 16 16:24:50.052485 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:24:50.716502 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3fabf69c-1e0f-441a-80f3-2baf79f31fdf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:50.844237 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8016accb-91ff-4d4d-9984-55a42fd2dc1b req-afa4d9ea-7ee6-443d-86db-71b199405f14 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:50.845833 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8016accb-91ff-4d4d-9984-55a42fd2dc1b req-afa4d9ea-7ee6-443d-86db-71b199405f14 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0470231 Sep 16 16:24:50.884359 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8016accb-91ff-4d4d-9984-55a42fd2dc1b req-d0a3a330-31c9-4f11-8f06-ee5e99c204cc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324020 Sep 16 16:24:51.058031 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b07aabd-bd39-47f0-8e88-4458178e5314 req-860692fa-8379-486c-a570-016ef3af4bf5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:51.059468 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4b07aabd-bd39-47f0-8e88-4458178e5314 req-860692fa-8379-486c-a570-016ef3af4bf5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.0457602 Sep 16 16:24:51.102225 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4b07aabd-bd39-47f0-8e88-4458178e5314 req-d259824a-cf62-471d-8213-c945fdedc6db tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362794 Sep 16 16:24:51.170442 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9e442c-4590-402d-be9c-d03ac747ec27 req-c48fa48b-e897-4f97-9d41-9d284afa887a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:51.171829 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ec9e442c-4590-402d-be9c-d03ac747ec27 req-c48fa48b-e897-4f97-9d41-9d284afa887a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0507772 Sep 16 16:24:51.208134 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ec9e442c-4590-402d-be9c-d03ac747ec27 req-904dd844-8951-42ea-aaf7-26db7571f378 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304384 Sep 16 16:24:51.332149 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-ba3eb328-9e3a-4471-8da4-ca2f88b0aaa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:51.333617 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-ba3eb328-9e3a-4471-8da4-ca2f88b0aaa5 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 1098 time: 0.0410430 Sep 16 16:24:51.448624 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-cb4a1176-aa11-49ba-98fc-5172c3023c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:51.450303 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-cb4a1176-aa11-49ba-98fc-5172c3023c83 service neutron] 10.222.0.66 "GET /v2.0/networks?id=53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 200 len: 919 time: 0.1060793 Sep 16 16:24:51.495669 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-9072cbcc-5c42-40a9-8dbb-6c16520b215c service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 200 len: 217 time: 0.0339060 Sep 16 16:24:51.552610 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-a89eddb3-3f2e-4f48-a19e-1387f0cbda23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:51.554237 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-a89eddb3-3f2e-4f48-a19e-1387f0cbda23 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 200 len: 858 time: 0.0463750 Sep 16 16:24:51.600900 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-989e3835-bec0-4504-bf3d-1dded7b38c71 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=53267936-cd43-4d76-85cb-9474bc332b78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0369961 Sep 16 16:24:51.704459 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-9df777ee-1e4c-4a87-adfb-2290a15b7196 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0921073 Sep 16 16:24:51.810384 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04d1a673-e66e-4f42-bcb0-7a8f8f73adbb req-be3d55f7-fe67-459c-974a-590c9ec96e55 service neutron] 10.222.0.66 "GET /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0962749 Sep 16 16:24:52.001411 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75678539-bf18-4f59-974c-8751c3e52722 req-c94676e7-af67-4156-a9b5-294b0b6d08fc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:52.002923 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-75678539-bf18-4f59-974c-8751c3e52722 req-c94676e7-af67-4156-a9b5-294b0b6d08fc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0491750 Sep 16 16:24:52.043413 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-75678539-bf18-4f59-974c-8751c3e52722 req-2648ff63-0547-4d2a-bfbb-647c18985869 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328321 Sep 16 16:24:52.113297 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-fce789a6-f6f0-44c8-8637-753153a2ac0b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:52.115727 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-fce789a6-f6f0-44c8-8637-753153a2ac0b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.0527012 Sep 16 16:24:52.292041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b58f15-f5d2-4d0d-9b64-0252c871ca28 req-fc535e99-67c2-4068-b998-149f29264809 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:52.293838 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-14b58f15-f5d2-4d0d-9b64-0252c871ca28 req-fc535e99-67c2-4068-b998-149f29264809 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=273adae0-6efc-4507-aa4d-869e04dc3e9f HTTP/1.1" status: 200 len: 945 time: 0.0748782 Sep 16 16:24:52.299144 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Deleting port c4a23598-f189-46c2-8418-2a4bc652cd85 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:24:52.307324 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:52.381399 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09eff06c-7c98-4aaa-9150-dc64e2aefd9b req-c197beb2-8e63-44db-9c18-8f5073f23a7c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:52.382800 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-09eff06c-7c98-4aaa-9150-dc64e2aefd9b req-c197beb2-8e63-44db-9c18-8f5073f23a7c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0549557 Sep 16 16:24:52.397449 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-14b58f15-f5d2-4d0d-9b64-0252c871ca28 req-8f572a80-3875-499c-a7f8-627c5962769b tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862820 Sep 16 16:24:52.426207 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] For port c4a23598-f189-46c2-8418-2a4bc652cd85, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=c4a23598-f189-46c2-8418-2a4bc652cd85,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:52.426562 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:52.434376 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-09eff06c-7c98-4aaa-9150-dc64e2aefd9b req-7f32f3b7-5544-4de7-b301-b45e58ce3f7b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434465 Sep 16 16:24:52.445600 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Calling delete_port for c4a23598-f189-46c2-8418-2a4bc652cd85 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:24:52.577855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:52.595852 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'e62f01f3-63a1-4192-9c47-7358f178184b', 'c4a23598-f189-46c2-8418-2a4bc652cd85'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:52.610303 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event deleted for resources: {'Port': ['ID=c4a23598-f189-46c2-8418-2a4bc652cd85,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:52.667201 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] No DVR routers for this DVR port c4a23598-f189-46c2-8418-2a4bc652cd85 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:24:52.670201 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:52.672643 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b7d0e7-08eb-4b21-9fcb-e8b539fbf2f3 req-cbfc72cc-2bee-48ca-9018-0a2621246de6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "DELETE /v2.0/ports/c4a23598-f189-46c2-8418-2a4bc652cd85 HTTP/1.1" status: 204 len: 173 time: 0.5465510 Sep 16 16:24:52.673080 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'name': 'network-vif-deleted', 'tag': 'c4a23598-f189-46c2-8418-2a4bc652cd85'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:52.675527 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a497e070-ab89-4063-a95f-08ee6b132ff7" -d '{"events": [{"server_uuid": "273adae0-6efc-4507-aa4d-869e04dc3e9f", "name": "network-vif-deleted", "tag": "c4a23598-f189-46c2-8418-2a4bc652cd85"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:52.734304 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6abe6595-7838-4fd8-9658-298592b1ca0b x-openstack-request-id: req-6abe6595-7838-4fd8-9658-298592b1ca0b {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:52.734902 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "273adae0-6efc-4507-aa4d-869e04dc3e9f", "name": "network-vif-deleted", "tag": "c4a23598-f189-46c2-8418-2a4bc652cd85", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:52.735169 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-6abe6595-7838-4fd8-9658-298592b1ca0b {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:52.735656 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '273adae0-6efc-4507-aa4d-869e04dc3e9f', 'name': 'network-vif-deleted', 'tag': 'c4a23598-f189-46c2-8418-2a4bc652cd85', 'status': 'completed', 'code': 200} Sep 16 16:24:53.161239 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6617da-ba9c-4688-a91c-e5be818cfe29 req-5cad2b74-d816-4bc5-b78f-525e2413b5f3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:53.162713 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2a6617da-ba9c-4688-a91c-e5be818cfe29 req-5cad2b74-d816-4bc5-b78f-525e2413b5f3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0478363 Sep 16 16:24:53.217065 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2a6617da-ba9c-4688-a91c-e5be818cfe29 req-a1677f27-fc7e-448e-8c8a-f015533d9e39 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436316 Sep 16 16:24:53.453590 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-56b8cb10-3bba-4231-bf20-c9894813e816 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:53.559248 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c83b47c9-9f4d-46e0-a2e8-df52bd8a659a req-12f93826-7c75-4215-aaf9-94a8ff31c995 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:53.560822 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c83b47c9-9f4d-46e0-a2e8-df52bd8a659a req-12f93826-7c75-4215-aaf9-94a8ff31c995 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0523047 Sep 16 16:24:53.601561 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c83b47c9-9f4d-46e0-a2e8-df52bd8a659a req-66c3348d-d12a-4c18-9857-91c48b7483a6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336614 Sep 16 16:24:53.718124 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:54.338827 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863ea090-6ca6-4057-96f0-e4c70c2067b1 req-d1250ff1-786c-46e4-ba5e-302e95922bb0 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:54.346493 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-863ea090-6ca6-4057-96f0-e4c70c2067b1 req-d1250ff1-786c-46e4-ba5e-302e95922bb0 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0602210 Sep 16 16:24:54.370328 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:54.391937 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-863ea090-6ca6-4057-96f0-e4c70c2067b1 req-33e09ff6-843d-48e5-8c42-486767fcd035 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440333 Sep 16 16:24:54.727185 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ac416ec-9581-4581-b0f4-b5d2d11f29b9 req-91397dbc-c1de-44ca-bd83-5559b773a819 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:54.734167 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5ac416ec-9581-4581-b0f4-b5d2d11f29b9 req-91397dbc-c1de-44ca-bd83-5559b773a819 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0594280 Sep 16 16:24:54.790339 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5ac416ec-9581-4581-b0f4-b5d2d11f29b9 req-c2b8504e-f4d7-4250-a19f-1803c2c74374 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425699 Sep 16 16:24:54.852507 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a552fd-2511-454f-8993-d984863c9608 req-6eac95f0-6d18-4705-ad34-e86b5e466358 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:54.854024 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e0a552fd-2511-454f-8993-d984863c9608 req-6eac95f0-6d18-4705-ad34-e86b5e466358 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 945 time: 0.0522208 Sep 16 16:24:54.907960 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e0a552fd-2511-454f-8993-d984863c9608 req-ed0aa328-511c-4c02-b7df-d13e78d637b1 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467031 Sep 16 16:24:55.268352 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device c4a23598-f189-46c2-8418-2a4bc652cd85 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:24:55.289402 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: c4a23598-f189-46c2-8418-2a4bc652cd85 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:24:55.289751 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device c4a23598-f189-46c2-8418-2a4bc652cd85 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:24:55.612703 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b617c9c7-cc76-471d-82bd-ad5f533a1711 req-11c97861-ec3c-4cd3-a5de-c97caddc91c2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:55.623527 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b617c9c7-cc76-471d-82bd-ad5f533a1711 req-11c97861-ec3c-4cd3-a5de-c97caddc91c2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1617444 Sep 16 16:24:55.695405 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b617c9c7-cc76-471d-82bd-ad5f533a1711 req-79eebfc9-805a-461e-9f50-930f89cde57a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665526 Sep 16 16:24:56.035241 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada5a21e-5a01-4bf8-8991-7d14adb0eda4 req-56d5c73c-f7d8-4a11-93d4-660816874dd7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:56.046646 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ada5a21e-5a01-4bf8-8991-7d14adb0eda4 req-56d5c73c-f7d8-4a11-93d4-660816874dd7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0771766 Sep 16 16:24:56.117635 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ada5a21e-5a01-4bf8-8991-7d14adb0eda4 req-6fb1156b-4457-4190-95a3-fe969227e13f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0675340 Sep 16 16:24:56.185724 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:56.251179 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe0efc2-368c-420c-999b-49f8861fa604 req-db958607-4359-4dab-9b79-abb72784cb89 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:56.252688 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7fe0efc2-368c-420c-999b-49f8861fa604 req-db958607-4359-4dab-9b79-abb72784cb89 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 945 time: 0.1252780 Sep 16 16:24:56.299760 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7fe0efc2-368c-420c-999b-49f8861fa604 req-336f73aa-6db3-4f4d-b29d-b94982dadc39 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399280 Sep 16 16:24:57.032442 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-26c7f54a-472c-4fb7-862c-45d0cfc69037 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:57.034012 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-26c7f54a-472c-4fb7-862c-45d0cfc69037 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 945 time: 0.0556686 Sep 16 16:24:57.158194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Deleting port e62f01f3-63a1-4192-9c47-7358f178184b {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:24:57.158600 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:57.229259 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97571da-3375-4394-b346-bbbf5dd81535 req-6cca23f1-9e74-4e61-a2a8-ac547e452a11 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:57.236789 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f97571da-3375-4394-b346-bbbf5dd81535 req-6cca23f1-9e74-4e61-a2a8-ac547e452a11 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0598943 Sep 16 16:24:57.270249 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] For port e62f01f3-63a1-4192-9c47-7358f178184b, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e62f01f3-63a1-4192-9c47-7358f178184b,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:24:57.270567 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:57.289310 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f97571da-3375-4394-b346-bbbf5dd81535 req-f2ce1992-272e-4590-bd36-92e51891a20a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511675 Sep 16 16:24:57.292562 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Calling delete_port for e62f01f3-63a1-4192-9c47-7358f178184b owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:24:57.439765 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:57.443915 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770207b0-4eb7-41d2-acf1-71ad29a31f91 req-8978f269-0ea3-4c76-ae42-e2fea01a8b96 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:57.446782 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-770207b0-4eb7-41d2-acf1-71ad29a31f91 req-8978f269-0ea3-4c76-ae42-e2fea01a8b96 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=b4de9ca9-e65c-4e85-9cff-dd6c718b10e3 HTTP/1.1" status: 200 len: 945 time: 0.0599530 Sep 16 16:24:57.459017 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'ec91d974-1df8-4ab5-991b-161fcd90cf2d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:24:57.495581 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event deleted for resources: {'Port': ['ID=e62f01f3-63a1-4192-9c47-7358f178184b,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:24:57.506474 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-770207b0-4eb7-41d2-acf1-71ad29a31f91 req-a5a513f3-1cfb-4d5f-b4f6-58e0210716a5 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473609 Sep 16 16:24:57.546125 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] No DVR routers for this DVR port e62f01f3-63a1-4192-9c47-7358f178184b on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:24:57.548823 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:24:57.551774 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0f06c118-6ef3-4028-8350-fb01b5502e01 req-d2d98bb3-c28d-44a3-8ce4-c514a7758f85 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "DELETE /v2.0/ports/e62f01f3-63a1-4192-9c47-7358f178184b HTTP/1.1" status: 204 len: 173 time: 0.5102975 Sep 16 16:24:57.552513 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'name': 'network-vif-deleted', 'tag': 'e62f01f3-63a1-4192-9c47-7358f178184b'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:24:57.555768 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1e1d5e4-e8e1-4637-a3ce-c58b8944f95e" -d '{"events": [{"server_uuid": "b4de9ca9-e65c-4e85-9cff-dd6c718b10e3", "name": "network-vif-deleted", "tag": "e62f01f3-63a1-4192-9c47-7358f178184b"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:24:57.607956 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:24:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2214569e-237f-487f-be6a-503566a42587 x-openstack-request-id: req-2214569e-237f-487f-be6a-503566a42587 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:24:57.608155 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4de9ca9-e65c-4e85-9cff-dd6c718b10e3", "name": "network-vif-deleted", "tag": "e62f01f3-63a1-4192-9c47-7358f178184b", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:24:57.608463 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-2214569e-237f-487f-be6a-503566a42587 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:24:57.608985 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4de9ca9-e65c-4e85-9cff-dd6c718b10e3', 'name': 'network-vif-deleted', 'tag': 'e62f01f3-63a1-4192-9c47-7358f178184b', 'status': 'completed', 'code': 200} Sep 16 16:24:58.368213 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c62193-e961-4aa7-843e-c8cfbc88d9f4 req-a7b8a0c0-8b62-4452-aa78-4d067bd46f3a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:58.370496 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-50c62193-e961-4aa7-843e-c8cfbc88d9f4 req-a7b8a0c0-8b62-4452-aa78-4d067bd46f3a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0624003 Sep 16 16:24:58.458342 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-50c62193-e961-4aa7-843e-c8cfbc88d9f4 req-fe590d4c-5065-4c39-bb64-21728cf5df8a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725515 Sep 16 16:24:58.489017 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d95bdf-e931-4f8e-b5d2-9aebb981bc37 req-cb94dd69-5976-4a27-8fcd-58a10b86f52f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:58.490618 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e6d95bdf-e931-4f8e-b5d2-9aebb981bc37 req-cb94dd69-5976-4a27-8fcd-58a10b86f52f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0536156 Sep 16 16:24:58.546615 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e6d95bdf-e931-4f8e-b5d2-9aebb981bc37 req-c96db9a8-8931-4c02-a641-aa0b859f53d2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464451 Sep 16 16:24:58.806313 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924df16b-9a83-477f-9900-10fc32efb80a req-9fbc529c-fd12-465b-a8d0-a361f6a48a51 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:58.807999 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-924df16b-9a83-477f-9900-10fc32efb80a req-9fbc529c-fd12-465b-a8d0-a361f6a48a51 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0521126 Sep 16 16:24:58.869231 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-924df16b-9a83-477f-9900-10fc32efb80a req-316158db-02e0-4eaf-ba38-5623eca8fcbc tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504043 Sep 16 16:24:59.297316 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e62f01f3-63a1-4192-9c47-7358f178184b no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:24:59.319716 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: e62f01f3-63a1-4192-9c47-7358f178184b {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:24:59.320077 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e62f01f3-63a1-4192-9c47-7358f178184b not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:24:59.569937 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24e236a-a529-4402-9fe5-6f1e137fb4ac req-a15195fb-3510-4600-b50b-5ce0ac8b620f tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:59.571517 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e24e236a-a529-4402-9fe5-6f1e137fb4ac req-a15195fb-3510-4600-b50b-5ce0ac8b620f tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0548120 Sep 16 16:24:59.618525 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e24e236a-a529-4402-9fe5-6f1e137fb4ac req-5da51b3f-142f-4a92-9db7-4b43d5327040 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400045 Sep 16 16:24:59.704015 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16992ede-d8df-4fb7-9865-1c6beac9e0a4 req-36818898-030a-4b45-ab72-cc95d326de48 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:59.705452 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-16992ede-d8df-4fb7-9865-1c6beac9e0a4 req-36818898-030a-4b45-ab72-cc95d326de48 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0649536 Sep 16 16:24:59.751804 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-16992ede-d8df-4fb7-9865-1c6beac9e0a4 req-ae08dc15-2f92-43d1-b58f-ba1c79aa5d25 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0366628 Sep 16 16:24:59.983773 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2747f2e-20db-48dd-a44b-dcf5079db016 req-380095d6-ffd3-4006-9e90-738a2541eea3 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:24:59.985413 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e2747f2e-20db-48dd-a44b-dcf5079db016 req-380095d6-ffd3-4006-9e90-738a2541eea3 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0484445 Sep 16 16:25:00.031786 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e2747f2e-20db-48dd-a44b-dcf5079db016 req-7b6195e6-e8f1-4cea-b0f7-ec1907b3a65d tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399873 Sep 16 16:25:00.746574 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871d21e4-8316-4247-9062-a988bf501eb6 req-405b48a8-f209-4e3d-8358-4c926438efd3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:00.748774 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-871d21e4-8316-4247-9062-a988bf501eb6 req-405b48a8-f209-4e3d-8358-4c926438efd3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0592058 Sep 16 16:25:00.809249 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-871d21e4-8316-4247-9062-a988bf501eb6 req-12fbf025-6bb4-4d5c-a2ff-1d152a46f5f8 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459707 Sep 16 16:25:00.818507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-9d53ba60-bd14-40de-bf96-bc9ee9a08cc3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:00.819517 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-9d53ba60-bd14-40de-bf96-bc9ee9a08cc3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 946 time: 0.0929291 Sep 16 16:25:00.985583 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a2013e-0d50-4f7c-b397-d54d9cf41963 req-13b7555e-1f12-4b66-ae5a-cc8b3a322581 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:00.987061 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04a2013e-0d50-4f7c-b397-d54d9cf41963 req-13b7555e-1f12-4b66-ae5a-cc8b3a322581 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0759137 Sep 16 16:25:01.002715 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Deleting port 2f874a79-207c-4bb2-b345-a04463be9822 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:01.003085 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.052351 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-ff1ec82e-774c-4262-a393-041504e25267 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:01.053908 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-ff1ec82e-774c-4262-a393-041504e25267 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.0581722 Sep 16 16:25:01.085782 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-04a2013e-0d50-4f7c-b397-d54d9cf41963 req-b691eee2-6ad6-42f9-aaab-ef25eea248fd tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0906367 Sep 16 16:25:01.134871 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0479861-0774-4218-9aad-64b81ea32836 req-ddfcd227-167b-439a-a9ed-3c2f6ff7fbc3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:01.136526 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a0479861-0774-4218-9aad-64b81ea32836 req-ddfcd227-167b-439a-a9ed-3c2f6ff7fbc3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0939314 Sep 16 16:25:01.166500 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] For port 2f874a79-207c-4bb2-b345-a04463be9822, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f874a79-207c-4bb2-b345-a04463be9822,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:01.167321 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.215054 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Calling delete_port for 2f874a79-207c-4bb2-b345-a04463be9822 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:01.223957 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a0479861-0774-4218-9aad-64b81ea32836 req-d3dabecc-730a-4dc6-bacc-6430fc2e7423 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780520 Sep 16 16:25:01.264212 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Deleting port ec91d974-1df8-4ab5-991b-161fcd90cf2d {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:01.264922 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.319449 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a93eb304-e024-427d-b6e6-f1a8d4a4960e req-94d913d3-cfb8-4eb2-acd6-4339deaccab8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:01.328358 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a93eb304-e024-427d-b6e6-f1a8d4a4960e req-94d913d3-cfb8-4eb2-acd6-4339deaccab8 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 945 time: 0.1580830 Sep 16 16:25:01.396928 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] For port ec91d974-1df8-4ab5-991b-161fcd90cf2d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ec91d974-1df8-4ab5-991b-161fcd90cf2d,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:01.397657 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.400851 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a93eb304-e024-427d-b6e6-f1a8d4a4960e req-83e9995c-1ea4-41f9-9896-d3313fccb989 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715468 Sep 16 16:25:01.425002 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Calling delete_port for ec91d974-1df8-4ab5-991b-161fcd90cf2d owned by compute:nova {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:01.487954 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.529161 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Pushing event deleted for resources: {'Port': ['ID=2f874a79-207c-4bb2-b345-a04463be9822,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:01.597255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] No DVR routers for this DVR port 2f874a79-207c-4bb2-b345-a04463be9822 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:01.623795 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.701916 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.704271 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c9750707-72a0-408e-aedc-f7de7b7ae8d6 req-43aaed8f-9312-46b5-be6f-42054359b2de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "DELETE /v2.0/ports/2f874a79-207c-4bb2-b345-a04463be9822 HTTP/1.1" status: 204 len: 173 time: 0.8720851 Sep 16 16:25:01.704825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'name': 'network-vif-deleted', 'tag': '2f874a79-207c-4bb2-b345-a04463be9822'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:01.707790 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33e7c55d-58da-4f7e-a8b3-53b806cad0f1" -d '{"events": [{"server_uuid": "af27223f-6b95-4186-88b6-dc57e7f510b7", "name": "network-vif-deleted", "tag": "2f874a79-207c-4bb2-b345-a04463be9822"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:01.734079 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event deleted for resources: {'Port': ['ID=ec91d974-1df8-4ab5-991b-161fcd90cf2d,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:01.757388 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:25:01.819980 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2fd4bf0d-30c5-4ab6-b388-32281afab42c x-openstack-request-id: req-2fd4bf0d-30c5-4ab6-b388-32281afab42c {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:01.821147 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af27223f-6b95-4186-88b6-dc57e7f510b7", "name": "network-vif-deleted", "tag": "2f874a79-207c-4bb2-b345-a04463be9822", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:01.821499 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-2fd4bf0d-30c5-4ab6-b388-32281afab42c {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:01.821959 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af27223f-6b95-4186-88b6-dc57e7f510b7', 'name': 'network-vif-deleted', 'tag': '2f874a79-207c-4bb2-b345-a04463be9822', 'status': 'completed', 'code': 200} Sep 16 16:25:01.824071 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] No DVR routers for this DVR port ec91d974-1df8-4ab5-991b-161fcd90cf2d on host hv-cinder-80588 {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:01.837792 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:01.840190 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-43c26c7b-31f8-4b8d-b41b-db79a3feb568 req-bf74d8f5-7558-46d2-a2f1-089840fed647 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "DELETE /v2.0/ports/ec91d974-1df8-4ab5-991b-161fcd90cf2d HTTP/1.1" status: 204 len: 173 time: 0.7726133 Sep 16 16:25:01.840928 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'name': 'network-vif-deleted', 'tag': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:01.849194 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b2e9c2b-eb9a-41e4-9b17-5d49dd7d5707" -d '{"events": [{"server_uuid": "61d82ed2-1452-4850-addf-fbe9461ec0ee", "name": "network-vif-deleted", "tag": "ec91d974-1df8-4ab5-991b-161fcd90cf2d"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:01.901085 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a7eb1a7-01f7-4079-8a9d-d19628e06930 x-openstack-request-id: req-8a7eb1a7-01f7-4079-8a9d-d19628e06930 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:01.901739 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61d82ed2-1452-4850-addf-fbe9461ec0ee", "name": "network-vif-deleted", "tag": "ec91d974-1df8-4ab5-991b-161fcd90cf2d", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:01.902152 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-8a7eb1a7-01f7-4079-8a9d-d19628e06930 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:01.902850 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61d82ed2-1452-4850-addf-fbe9461ec0ee', 'name': 'network-vif-deleted', 'tag': 'ec91d974-1df8-4ab5-991b-161fcd90cf2d', 'status': 'completed', 'code': 200} Sep 16 16:25:01.986688 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3b84c71e-6043-426a-80fc-a4fd10dc83d7 req-0333b81d-da10-4430-ba20-7296c036d936 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=af27223f-6b95-4186-88b6-dc57e7f510b7 HTTP/1.1" status: 200 len: 210 time: 0.0534961 Sep 16 16:25:02.233876 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c8134d-81a6-4d6c-9cdf-26184d28120c req-459ebaba-6624-4d96-955b-4ebc7118eec3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:02.235838 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-27c8134d-81a6-4d6c-9cdf-26184d28120c req-459ebaba-6624-4d96-955b-4ebc7118eec3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0630174 Sep 16 16:25:02.287158 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-27c8134d-81a6-4d6c-9cdf-26184d28120c req-c495ab92-9255-4d1b-860b-53d19a6ba59c tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441420 Sep 16 16:25:02.391689 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8688fe71-3aeb-42e6-bf94-b5518fd8d186 req-45f62c44-5e12-438f-93b6-ec025267a852 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:02.400404 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8688fe71-3aeb-42e6-bf94-b5518fd8d186 req-45f62c44-5e12-438f-93b6-ec025267a852 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0893455 Sep 16 16:25:02.472447 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8688fe71-3aeb-42e6-bf94-b5518fd8d186 req-56b1dd0e-d55d-465e-a1fb-8acdd20b33d2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710635 Sep 16 16:25:02.637150 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f3daf46d-2db1-4e56-936c-ddb8df811c51 req-f69fd7a1-41e7-4775-a13e-23dcd154ee9c tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=61d82ed2-1452-4850-addf-fbe9461ec0ee HTTP/1.1" status: 200 len: 210 time: 0.0345252 Sep 16 16:25:02.665093 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cce672b-4a5d-4d80-898f-1af8a60f721c req-bb402518-ec0b-47a0-9f2a-374c689ea1d7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:02.666859 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1cce672b-4a5d-4d80-898f-1af8a60f721c req-bb402518-ec0b-47a0-9f2a-374c689ea1d7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0830777 Sep 16 16:25:02.740590 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1cce672b-4a5d-4d80-898f-1af8a60f721c req-8b8ac95e-43d6-4eba-9cb4-f2baf70aca12 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0619824 Sep 16 16:25:02.748309 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-10cc8131-6dfa-4c43-95f7-7bdc715f82cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:02.750241 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-10cc8131-6dfa-4c43-95f7-7bdc715f82cc service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1099 time: 0.0798059 Sep 16 16:25:02.877478 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-1519ddb3-baa4-4ec9-b347-264b6455d033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:02.879064 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-1519ddb3-baa4-4ec9-b347-264b6455d033 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.1190541 Sep 16 16:25:02.980978 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-b615e3e2-2d75-4fc2-9fb6-cdc729188b76 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 1001 time: 0.0928588 Sep 16 16:25:03.235596 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-3ec96ad9-5ccf-4f29-94c0-cedf7bb4b2ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:03.236966 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-3ec96ad9-5ccf-4f29-94c0-cedf7bb4b2ce service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.2479801 Sep 16 16:25:03.309142 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-219f36e6-5f85-4a54-8509-d888f289d4bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:03.310656 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-219f36e6-5f85-4a54-8509-d888f289d4bc service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0577118 Sep 16 16:25:03.318298 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f874a79-207c-4bb2-b345-a04463be9822 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:03.346739 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: 2f874a79-207c-4bb2-b345-a04463be9822 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:03.347081 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f874a79-207c-4bb2-b345-a04463be9822 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:03.347534 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec91d974-1df8-4ab5-991b-161fcd90cf2d no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:03.366829 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: ec91d974-1df8-4ab5-991b-161fcd90cf2d {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:03.367571 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ec91d974-1df8-4ab5-991b-161fcd90cf2d not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:03.418314 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-597ef25b-01b4-46e3-a36b-0f55c97dd9d6 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860825 Sep 16 16:25:03.519117 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-96c3e7ac-6e75-488d-bc1d-290241f19646 req-fc64fdec-40c0-49f3-b9d2-480d94806cc7 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908191 Sep 16 16:25:03.624603 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34735aca-8b97-47ba-94a3-31e70e1f628a req-4664d612-9454-4f7f-87a7-8ae84d04a1d3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:03.626370 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-34735aca-8b97-47ba-94a3-31e70e1f628a req-4664d612-9454-4f7f-87a7-8ae84d04a1d3 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0535488 Sep 16 16:25:03.665640 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-34735aca-8b97-47ba-94a3-31e70e1f628a req-4e36def7-7bbe-4298-b96a-110fb8fb47a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325334 Sep 16 16:25:03.853210 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46577a2c-0681-4fe9-a70c-e9a20ef32dbd req-b7ddd39a-79e8-4072-ab6d-59bd69001974 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:03.854671 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-46577a2c-0681-4fe9-a70c-e9a20ef32dbd req-b7ddd39a-79e8-4072-ab6d-59bd69001974 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0480990 Sep 16 16:25:03.891869 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-46577a2c-0681-4fe9-a70c-e9a20ef32dbd req-6a8511ff-57cd-4f29-8274-6d2443b18584 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313268 Sep 16 16:25:04.785496 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb76bbf9-59fc-48f8-a69a-131715c2f490 req-2939783d-2d09-4cfc-a17b-ecd6c2737d5f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:04.786927 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb76bbf9-59fc-48f8-a69a-131715c2f490 req-2939783d-2d09-4cfc-a17b-ecd6c2737d5f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0462041 Sep 16 16:25:04.827431 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb76bbf9-59fc-48f8-a69a-131715c2f490 req-decbc382-5dd3-4350-a08f-27c181839fc8 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341549 Sep 16 16:25:05.012585 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b56553-ce00-417c-b7f2-1eeafc066f9a req-04614472-d2ff-49f2-8042-299b7719ff09 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:05.014070 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-65b56553-ce00-417c-b7f2-1eeafc066f9a req-04614472-d2ff-49f2-8042-299b7719ff09 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0505261 Sep 16 16:25:05.054726 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-65b56553-ce00-417c-b7f2-1eeafc066f9a req-bcb6c0be-f035-489c-b40d-6af924938961 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0331695 Sep 16 16:25:05.957940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2c62de-17ef-4080-a615-228c0adf49be req-aa7253ff-c1fd-45df-ad1b-c34cdcffef77 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:05.959456 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ec2c62de-17ef-4080-a615-228c0adf49be req-aa7253ff-c1fd-45df-ad1b-c34cdcffef77 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0592453 Sep 16 16:25:06.002279 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ec2c62de-17ef-4080-a615-228c0adf49be req-ab111f55-ca22-4af3-84ed-4a7d5d63db60 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362527 Sep 16 16:25:06.184384 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c123e880-e274-4baa-b878-d62da0821640 req-c322bafe-310c-4fc8-a9fe-4c150510e66e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:06.187664 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c123e880-e274-4baa-b878-d62da0821640 req-c322bafe-310c-4fc8-a9fe-4c150510e66e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0588131 Sep 16 16:25:06.233639 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c123e880-e274-4baa-b878-d62da0821640 req-b10dd19e-9339-4473-bae4-c35b6797a229 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412500 Sep 16 16:25:07.126817 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f29a05-c5b1-4abf-8f30-d11f69d84f8c req-9256552c-73a8-46c9-99fa-719ce00483a9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:07.128366 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b2f29a05-c5b1-4abf-8f30-d11f69d84f8c req-9256552c-73a8-46c9-99fa-719ce00483a9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0531504 Sep 16 16:25:07.166921 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b2f29a05-c5b1-4abf-8f30-d11f69d84f8c req-fc503a81-b4b1-4e8a-a785-066bf5b94ec7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318971 Sep 16 16:25:07.354749 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd07f9a-0045-4966-8811-ec6af0d48a2e req-2c7c7cdd-dca9-4139-84ea-d566910c6e45 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:07.356212 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8cd07f9a-0045-4966-8811-ec6af0d48a2e req-2c7c7cdd-dca9-4139-84ea-d566910c6e45 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0479507 Sep 16 16:25:07.409086 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8cd07f9a-0045-4966-8811-ec6af0d48a2e req-9c5e4c42-dd26-4893-b67b-84c1c4fcded6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464144 Sep 16 16:25:07.503397 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-94545239-b551-48a1-bbb7-067cd1c767b8 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:07.505252 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-94545239-b551-48a1-bbb7-067cd1c767b8 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 946 time: 0.0549283 Sep 16 16:25:07.622472 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Deleting port 4056f695-287f-45f7-bd60-21b6a8421280 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:07.623049 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:07.715360 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] For port 4056f695-287f-45f7-bd60-21b6a8421280, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=4056f695-287f-45f7-bd60-21b6a8421280,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:07.715730 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:07.734000 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Calling delete_port for 4056f695-287f-45f7-bd60-21b6a8421280 owned by compute:nova {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:07.892281 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:07.905800 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['4056f695-287f-45f7-bd60-21b6a8421280', 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:25:07.927794 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Pushing event deleted for resources: {'Port': ['ID=4056f695-287f-45f7-bd60-21b6a8421280,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:07.968184 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.968530 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.968922 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.969896 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.970349 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.970885 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.971062 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.971958 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.971958 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.972190 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.972974 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.973323 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:07.998729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] No DVR routers for this DVR port 4056f695-287f-45f7-bd60-21b6a8421280 on host hv-cinder-80588 {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:08.001806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:08.003947 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-562d5d88-d4c2-40b3-a6e2-9120000313ad req-402090b5-46e3-4a99-8397-99a2728591a1 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "DELETE /v2.0/ports/4056f695-287f-45f7-bd60-21b6a8421280 HTTP/1.1" status: 204 len: 173 time: 0.4829283 Sep 16 16:25:08.004387 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'name': 'network-vif-deleted', 'tag': '4056f695-287f-45f7-bd60-21b6a8421280'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:08.011261 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-259c1acd-0562-4da9-ab15-522be9cbc851" -d '{"events": [{"server_uuid": "f4270a41-8af0-4e57-9dc8-15227e6ab264", "name": "network-vif-deleted", "tag": "4056f695-287f-45f7-bd60-21b6a8421280"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:08.098234 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-364a88ee-6ef6-432c-9950-f914cd17730e x-openstack-request-id: req-364a88ee-6ef6-432c-9950-f914cd17730e {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:08.098642 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4270a41-8af0-4e57-9dc8-15227e6ab264", "name": "network-vif-deleted", "tag": "4056f695-287f-45f7-bd60-21b6a8421280", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:08.099011 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-364a88ee-6ef6-432c-9950-f914cd17730e {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:08.099580 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4270a41-8af0-4e57-9dc8-15227e6ab264', 'name': 'network-vif-deleted', 'tag': '4056f695-287f-45f7-bd60-21b6a8421280', 'status': 'completed', 'code': 200} Sep 16 16:25:08.303775 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7ffc51e6-7828-4ec6-a6d1-21d9fcd2fb49 req-9fe28c70-51e8-44f2-a390-a61880e83f5f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=f4270a41-8af0-4e57-9dc8-15227e6ab264 HTTP/1.1" status: 200 len: 210 time: 0.0259483 Sep 16 16:25:08.322916 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec774e0-ec81-4d33-88b9-c9471845b3b3 req-ec22ebaf-10e4-4b29-99a1-f502f6d44c01 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:08.327946 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2ec774e0-ec81-4d33-88b9-c9471845b3b3 req-ec22ebaf-10e4-4b29-99a1-f502f6d44c01 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0522349 Sep 16 16:25:08.371755 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2ec774e0-ec81-4d33-88b9-c9471845b3b3 req-830b6c0b-910f-4fbd-8199-de80aa66411f tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405810 Sep 16 16:25:08.615302 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079dad64-ace3-4e3c-b1f6-cace107e9bf1 req-2e33a6f2-7883-4253-902e-276cb646a808 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:08.622263 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-079dad64-ace3-4e3c-b1f6-cace107e9bf1 req-2e33a6f2-7883-4253-902e-276cb646a808 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.1203902 Sep 16 16:25:08.695824 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-079dad64-ace3-4e3c-b1f6-cace107e9bf1 req-68dec6c0-9a42-40c1-b45c-a69f980ca52e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0731192 Sep 16 16:25:09.493036 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386ef23a-7287-48d7-975e-13cdee9ef660 req-f4d01f60-9e5a-458d-a31e-e3c20fd01d64 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:09.501309 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-386ef23a-7287-48d7-975e-13cdee9ef660 req-f4d01f60-9e5a-458d-a31e-e3c20fd01d64 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0586019 Sep 16 16:25:09.550692 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-386ef23a-7287-48d7-975e-13cdee9ef660 req-05063c35-1ef2-41c0-aec3-da1d7040cf02 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482612 Sep 16 16:25:09.616094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ffffad-f19f-49d7-801b-a5dd0169484e req-3cd5f323-7ffb-45d3-b209-1fac0ad3961a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:09.618109 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e3ffffad-f19f-49d7-801b-a5dd0169484e req-3cd5f323-7ffb-45d3-b209-1fac0ad3961a tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0513449 Sep 16 16:25:09.664802 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e3ffffad-f19f-49d7-801b-a5dd0169484e req-7094e5ce-423f-4e08-8078-5a0e71a2f164 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393343 Sep 16 16:25:10.667528 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b16e7465-9d25-4669-bae7-056e6f795c12 req-af3d747f-bdf2-4168-a40e-85d61c756375 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:10.668970 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b16e7465-9d25-4669-bae7-056e6f795c12 req-af3d747f-bdf2-4168-a40e-85d61c756375 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0464919 Sep 16 16:25:10.706026 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b16e7465-9d25-4669-bae7-056e6f795c12 req-367e5d8d-2f64-46e3-9bcb-47750e81740a tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313418 Sep 16 16:25:10.779518 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059f12c-e3e9-42f8-a43b-d9ba290bae60 req-770903ce-ea79-4529-8bd8-a4f756e9b172 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:10.780992 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1059f12c-e3e9-42f8-a43b-d9ba290bae60 req-770903ce-ea79-4529-8bd8-a4f756e9b172 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0468850 Sep 16 16:25:10.818793 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1059f12c-e3e9-42f8-a43b-d9ba290bae60 req-cc165e79-f7ef-4460-9ab8-2218567c47bf tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320826 Sep 16 16:25:11.819068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be2f11e-0e83-481d-8647-9e6986255248 req-154b7209-7613-4025-8c05-ca4e96d757c4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:11.821187 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0be2f11e-0e83-481d-8647-9e6986255248 req-154b7209-7613-4025-8c05-ca4e96d757c4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0470281 Sep 16 16:25:11.860628 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0be2f11e-0e83-481d-8647-9e6986255248 req-9f9d7b25-e7b2-431c-bb7b-0101ee6355bb tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334098 Sep 16 16:25:11.931068 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb13457c-0575-42e5-beac-a736fa1119bd req-81cf87bd-a4f2-4008-a5f9-7300a1550c8c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:11.932623 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fb13457c-0575-42e5-beac-a736fa1119bd req-81cf87bd-a4f2-4008-a5f9-7300a1550c8c tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0485177 Sep 16 16:25:11.968638 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fb13457c-0575-42e5-beac-a736fa1119bd req-3ded55d5-8fde-4ae1-930d-116bf62f3b1b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302205 Sep 16 16:25:12.161656 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 4056f695-287f-45f7-bd60-21b6a8421280 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:12.182222 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: 4056f695-287f-45f7-bd60-21b6a8421280 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:12.182498 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 4056f695-287f-45f7-bd60-21b6a8421280 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:12.972013 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983d7be-c825-4fbe-a019-260e7fa7c688 req-ca8330df-8da6-422b-ae00-d59d4f1959b4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:12.973892 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f983d7be-c825-4fbe-a019-260e7fa7c688 req-ca8330df-8da6-422b-ae00-d59d4f1959b4 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0486393 Sep 16 16:25:13.013591 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f983d7be-c825-4fbe-a019-260e7fa7c688 req-3c5cea94-d6b7-41a9-8915-55a069550ef6 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/security-groups?id=1d064230-2081-4062-abd9-634d63aa4380&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331242 Sep 16 16:25:13.100538 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-0f2cd4a2-0e6e-42e6-9b34-ea7cfca0fc78 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:13.102646 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-0f2cd4a2-0e6e-42e6-9b34-ea7cfca0fc78 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 945 time: 0.0926840 Sep 16 16:25:13.120375 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b5b829-5db1-4c43-acea-fb1eb487e50c req-d4df8ff8-849c-42d2-97c6-d22b27a1ab25 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:13.121877 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f9b5b829-5db1-4c43-acea-fb1eb487e50c req-d4df8ff8-849c-42d2-97c6-d22b27a1ab25 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0788069 Sep 16 16:25:13.183747 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f9b5b829-5db1-4c43-acea-fb1eb487e50c req-e63f9727-1be7-4f50-9d72-12c94c4ae46b tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545516 Sep 16 16:25:13.244300 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Deleting port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:13.244648 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:13.260595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ae461720-5cc8-416d-8be5-5f0ce346fbdd tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:13.262104 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ae461720-5cc8-416d-8be5-5f0ce346fbdd tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/networks?id=bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 200 len: 813 time: 0.1254959 Sep 16 16:25:13.279324 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-52de442c-05d1-4b9c-aa79-53a631b3ed48 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/quotas/6560ff6c16c54d39bd054561aad63a12 HTTP/1.1" status: 200 len: 375 time: 0.0115023 Sep 16 16:25:13.318195 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-11caee3e-4da8-45fd-bc2a-dc5532ff5e10 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=6560ff6c16c54d39bd054561aad63a12&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0281761 Sep 16 16:25:13.346454 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] For port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,segment=NetworkSegment(527820c5-a337-4239-b438-0c52b8d78dde),segment_id=527820c5-a337-4239-b438-0c52b8d78dde)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:13.347195 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:13.361601 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Calling delete_port for 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 owned by compute:nova {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:13.415773 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-a98c5e68-e573-43fc-ab59-8e70e2587305 service neutron] 10.222.0.59 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895369 Sep 16 16:25:13.521087 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:13.524299 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-d2cc2df3-991f-47a0-8bf6-7017574a7618 service neutron] 10.222.0.59 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0963516 Sep 16 16:25:13.533159 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['2f6c8a4f-a8c2-4261-b743-89b4b84383d3'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:25:13.561559 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Pushing event deleted for resources: {'Port': ['ID=2f6c8a4f-a8c2-4261-b743-89b4b84383d3,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:13.612521 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] No DVR routers for this DVR port 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 on host hv-cinder-80588 {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:13.615802 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:13.618393 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ca796ad4-38ad-4d6a-a1f2-11f8dc22bdac req-ef204683-0f3b-4d68-b8b8-697a92564758 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.66 "DELETE /v2.0/ports/2f6c8a4f-a8c2-4261-b743-89b4b84383d3 HTTP/1.1" status: 204 len: 173 time: 0.5060480 Sep 16 16:25:13.618981 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'name': 'network-vif-deleted', 'tag': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:13.621729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca48e0c7-226d-4e1c-9b9c-c6cb06849173" -d '{"events": [{"server_uuid": "2c827e7d-de34-4f39-9e3e-62e6bc0c387c", "name": "network-vif-deleted", "tag": "2f6c8a4f-a8c2-4261-b743-89b4b84383d3"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:13.674244 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90180f9a-3c8f-4217-98bb-130aa2843191 x-openstack-request-id: req-90180f9a-3c8f-4217-98bb-130aa2843191 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:13.674538 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c827e7d-de34-4f39-9e3e-62e6bc0c387c", "name": "network-vif-deleted", "tag": "2f6c8a4f-a8c2-4261-b743-89b4b84383d3", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:13.674837 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-90180f9a-3c8f-4217-98bb-130aa2843191 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:13.675294 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c827e7d-de34-4f39-9e3e-62e6bc0c387c', 'name': 'network-vif-deleted', 'tag': '2f6c8a4f-a8c2-4261-b743-89b4b84383d3', 'status': 'completed', 'code': 200} Sep 16 16:25:13.731390 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c352a1cc-12ef-4682-88e7-6bc307eb2a2c req-c6303bcd-bb57-40d3-9351-1deb5258df62 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 210 time: 0.0328672 Sep 16 16:25:14.148897 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6e059727-e5ef-455a-8ea5-8f84ceaf3aab req-8fcba5ba-55cb-4037-9103-5fbc4b653dd9 tempest-AttachVolumeNegativeTest-745603796 tempest-AttachVolumeNegativeTest-745603796-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c827e7d-de34-4f39-9e3e-62e6bc0c387c HTTP/1.1" status: 200 len: 210 time: 0.0424984 Sep 16 16:25:14.312153 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b606b41c-59de-4633-8699-9365e3bf2979 req-53684949-c8ae-4717-8c87-8b239cc71dc5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:14.313725 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b606b41c-59de-4633-8699-9365e3bf2979 req-53684949-c8ae-4717-8c87-8b239cc71dc5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0517395 Sep 16 16:25:14.355175 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b606b41c-59de-4633-8699-9365e3bf2979 req-5098055d-d193-478c-9ef5-570b57f16404 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350804 Sep 16 16:25:14.680032 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-9ece6c20-be09-44ae-8249-3eb8edd1a6ba service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390768 Sep 16 16:25:14.747398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f781471d-d8bc-434c-9201-de2e80960fcb req-d831f7f1-9ede-49a6-90a7-4e836c7df4ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:14.749050 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-d831f7f1-9ede-49a6-90a7-4e836c7df4ed service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1099 time: 0.0417883 Sep 16 16:25:14.854572 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6b573a5a-1659-4329-b9d9-679d59d760e2 req-9267bd88-843c-4e2e-85f8-598f3c6eb783 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 210 time: 0.0524955 Sep 16 16:25:14.880161 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f781471d-d8bc-434c-9201-de2e80960fcb req-1ef7ee41-e079-4ce0-a13a-99ce10e930e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:14.881586 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-1ef7ee41-e079-4ce0-a13a-99ce10e930e8 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.1072774 Sep 16 16:25:14.948313 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-c8b5bd0d-dfed-4848-841a-ca05180d572f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 1001 time: 0.0579369 Sep 16 16:25:15.004749 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f781471d-d8bc-434c-9201-de2e80960fcb req-a66952cd-3b46-40de-8576-796b4923c53c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:15.006667 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-a66952cd-3b46-40de-8576-796b4923c53c service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0447261 Sep 16 16:25:15.072055 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f781471d-d8bc-434c-9201-de2e80960fcb req-7bf101d2-d479-4c35-8866-4751d03faa8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:15.073593 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-7bf101d2-d479-4c35-8866-4751d03faa8c service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0471706 Sep 16 16:25:15.074200 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40818) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:15.159199 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_v2 [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Deleting subnet a059b6f3-51b1-44ce-96d4-f56363397303 {{(pid=93951) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:25:15.169313 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.173190 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-d5a2a363-27af-4a70-92fc-96e87c62f224 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874364 Sep 16 16:25:15.221863 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-3368384a-1e82-4ab3-bc03-386e29b16249 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:15.222095 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40828) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:15.223377 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-3368384a-1e82-4ab3-bc03-386e29b16249 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "GET /v2.0/networks?id=bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 200 len: 813 time: 0.1960595 Sep 16 16:25:15.234637 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-58472601'] for subnet, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.256641 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Request body: {'port': {'device_id': 'c71b7513-9f0d-4464-85af-085977775e81', 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7', 'admin_state_up': True, 'tenant_id': '6560ff6c16c54d39bd054561aad63a12'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:15.305950 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Deleting subnet 57a636e1-0951-4c2f-8be2-8ca36acb1d05 {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:25:15.311120 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.330340 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.343030 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f781471d-d8bc-434c-9201-de2e80960fcb req-ba4bac29-468e-43eb-8013-af0a213cc4aa service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1608281 Sep 16 16:25:15.353839 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.408678 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.418893 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-58361729', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58434304'] for subnet, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.427470 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Made reservation on behalf of 6560ff6c16c54d39bd054561aad63a12 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:25:15.431502 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.458114 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a059b6f3-51b1-44ce-96d4-f56363397303,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:15.465418 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.469524 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/a059b6f3-51b1-44ce-96d4-f56363397303 HTTP/1.1" status: 204 len: 168 time: 0.3920929 Sep 16 16:25:15.471249 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40832) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:15.475772 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.476166 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.476516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.476978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.477239 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.477687 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.477901 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.478237 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.478568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.478892 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.479236 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.479565 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-695849d4-1146-4264-9462-07bb6c925467 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:15.563642 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12708cd0-f27e-44a4-b5e0-1acb5eb36e0b req-ff4760c5-47ec-4d02-8d5a-5bae0d7309dc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:15.565287 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-12708cd0-f27e-44a4-b5e0-1acb5eb36e0b req-ff4760c5-47ec-4d02-8d5a-5bae0d7309dc tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1304376 Sep 16 16:25:15.568006 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.582367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.587981 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Allocated IP 172.20.0.8 (bbef521b-499c-40f5-ae34-4960093b92d7/dd7da63f-e08a-4fc1-87c9-93051b7a7b60/7394feb1-3144-433b-bf8b-cff90d88c5fb) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:15.609148 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=57a636e1-0951-4c2f-8be2-8ca36acb1d05,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:15.611316 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.615468 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e8f5855c-6e82-4b47-a32b-14d4f515f381 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/57a636e1-0951-4c2f-8be2-8ca36acb1d05 HTTP/1.1" status: 204 len: 168 time: 0.3896654 Sep 16 16:25:15.619133 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40834) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:15.662160 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-12708cd0-f27e-44a4-b5e0-1acb5eb36e0b req-642fba9e-2ce0-4575-8b8e-8f00130fb8e7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852590 Sep 16 16:25:15.662614 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.720692 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.721794 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.745593 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6552c4e5-d945-44f2-a079-8db3b3dd41c5']}} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:15.754594 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698') {'for_net_delete': True} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:15.754889 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'abe40faa-ea6a-4cb2-b2fb-49b96ee48698') {} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:15.764396 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64152858'] for segment, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.777936 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.783696 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Releasing vlan 738 on physical network physnet1 to pool {{(pid=93950) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:25:15.784078 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-65204239'] for segment, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: Traceback (most recent call last): Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: timer() Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: cb(*args, **kw) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: return func(*args, **kwargs) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: self._notify() Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: self.callback(batched_events) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: event.method(event) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: return f(self, *a, **k) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._get(url).json() Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: return self.request(url, 'GET', **kwargs) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:25:15.785994 dv-cinder-805887-15-iscsi neutron-server[93950]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:25:15.840258 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.845693 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.847966 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] 10.222.0.59 "DELETE /v2.0/networks/6552c4e5-d945-44f2-a079-8db3b3dd41c5 HTTP/1.1" status: 204 len: 168 time: 0.3758004 Sep 16 16:25:15.857332 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.859517 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.863399 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad03879-dcca-4eea-ae4f-1391aced32f8 admin admin] Pushing event deleted for resources: {'Network': ['ID=6552c4e5-d945-44f2-a079-8db3b3dd41c5,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:15.888050 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['143ad357-dcc1-47a6-a228-62d36164e62c']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:15.899922 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '527820c5-a337-4239-b438-0c52b8d78dde') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:15.900213 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '527820c5-a337-4239-b438-0c52b8d78dde') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:15.917108 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.954584 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.957737 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-653a2104-8915-4b60-a16a-a665678917f4 req-b40de1ee-137d-4a06-94b5-d458cee71e3b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 210 time: 0.0336864 Sep 16 16:25:15.963041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Releasing vlan 703 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:25:15.963639 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:25:15.965418 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:25:15.976740 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.058064 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Network bbef521b-499c-40f5-ae34-4960093b92d7 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:16.058494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40840) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:16.059674 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.061147 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:16.068296 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:16.084099 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.086488 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] 10.222.0.59 "DELETE /v2.0/networks/143ad357-dcc1-47a6-a228-62d36164e62c HTTP/1.1" status: 204 len: 168 time: 0.4663818 Sep 16 16:25:16.087194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Pushing event updated for resources: {'Port': ['ID=7394feb1-3144-433b-bf8b-cff90d88c5fb,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:16.106812 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-192de64a-8aa3-456e-82a7-12a6b8d948a7 admin admin] Pushing event deleted for resources: {'Network': ['ID=143ad357-dcc1-47a6-a228-62d36164e62c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:16.115846 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-34917041-e4c4-47c8-98ad-50174b99c623 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f5178fe3547b432792996a0b47d8a025&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0529394 Sep 16 16:25:16.116021 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40844) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:16.136041 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:16.136968 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.152125 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-81b34694-b6f3-4362-8e18-f5ab18e71324 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9152560 Sep 16 16:25:16.169461 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-552050fb-718e-4b6d-84c3-e1423d4177bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.174476 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Request body: {'port': {'device_id': 'c71b7513-9f0d-4464-85af-085977775e81', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:16.191081 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-552050fb-718e-4b6d-84c3-e1423d4177bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.206263 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:16.232763 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:16.233379 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 2f6c8a4f-a8c2-4261-b743-89b4b84383d3 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:16.240431 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.250110 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-552050fb-718e-4b6d-84c3-e1423d4177bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.253548 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-552050fb-718e-4b6d-84c3-e1423d4177bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.254751 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-552050fb-718e-4b6d-84c3-e1423d4177bf admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/994c0e1d-ee8c-408f-bc54-75e786c084ab HTTP/1.1" status: 204 len: 168 time: 0.1376832 Sep 16 16:25:16.265819 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-552050fb-718e-4b6d-84c3-e1423d4177bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=994c0e1d-ee8c-408f-bc54-75e786c084ab,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:16.312203 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40850) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:16.363404 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-02c25e37-f93b-4735-9bee-61086b845fd5 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0378b53234de487d8ebc6eeb3fbfbe5d&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0495756 Sep 16 16:25:16.364044 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40852) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:16.422566 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7368097c-11fe-4d40-a268-e536260bca1d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.447717 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7368097c-11fe-4d40-a268-e536260bca1d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.511580 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7368097c-11fe-4d40-a268-e536260bca1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.514176 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7368097c-11fe-4d40-a268-e536260bca1d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.517674 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7368097c-11fe-4d40-a268-e536260bca1d admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1d064230-2081-4062-abd9-634d63aa4380 HTTP/1.1" status: 204 len: 168 time: 0.1499953 Sep 16 16:25:16.529441 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7368097c-11fe-4d40-a268-e536260bca1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d064230-2081-4062-abd9-634d63aa4380,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:16.792617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7394feb1-3144-433b-bf8b-cff90d88c5fb {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:25:16.801365 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.815332 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Transition to ACTIVE for port object 7394feb1-3144-433b-bf8b-cff90d88c5fb will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:25:16.819056 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5adf347b-e5dd-41f3-946c-28a37d44ac92 req-2087741e-afb1-4995-a155-3a13c5ecb9d7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:16.821503 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5adf347b-e5dd-41f3-946c-28a37d44ac92 req-2087741e-afb1-4995-a155-3a13c5ecb9d7 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0812578 Sep 16 16:25:16.822130 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:16.872425 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5adf347b-e5dd-41f3-946c-28a37d44ac92 req-9243336e-5b04-4dfd-a316-875390717362 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415599 Sep 16 16:25:16.890219 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Pushing event updated for resources: {'Port': ['ID=7394feb1-3144-433b-bf8b-cff90d88c5fb,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:16.944491 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Attempting to bind port 7394feb1-3144-433b-bf8b-cff90d88c5fb on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:16.945697 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Attempting to bind port 7394feb1-3144-433b-bf8b-cff90d88c5fb by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:16.946295 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Attempting to bind port 7394feb1-3144-433b-bf8b-cff90d88c5fb on network bbef521b-499c-40f5-ae34-4960093b92d7 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:16.950503 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Port 7394feb1-3144-433b-bf8b-cff90d88c5fb on network bbef521b-499c-40f5-ae34-4960093b92d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:25:16.950985 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Attempting to bind port 7394feb1-3144-433b-bf8b-cff90d88c5fb on network bbef521b-499c-40f5-ae34-4960093b92d7 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:16.955993 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:16.956301 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Checking segment: {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:16.956684 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Bound using segment: {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:16.957101 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Bound port: 7394feb1-3144-433b-bf8b-cff90d88c5fb, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dd570390-2af3-48dd-9731-814c63fe3614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 745, 'network_id': 'bbef521b-499c-40f5-ae34-4960093b92d7'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:16.957483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:17.032263 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] For port 7394feb1-3144-433b-bf8b-cff90d88c5fb, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:17.037192 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] For port 7394feb1-3144-433b-bf8b-cff90d88c5fb, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=7394feb1-3144-433b-bf8b-cff90d88c5fb,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:17.042789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:17.131467 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.132816 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:17.134279 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] 10.222.0.66 "PUT /v2.0/ports/7394feb1-3144-433b-bf8b-cff90d88c5fb HTTP/1.1" status: 200 len: 1093 time: 0.9638948 Sep 16 16:25:17.134636 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c71b7513-9f0d-4464-85af-085977775e81', 'tag': '7394feb1-3144-433b-bf8b-cff90d88c5fb'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:17.136906 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5" -d '{"events": [{"name": "network-changed", "server_uuid": "c71b7513-9f0d-4464-85af-085977775e81", "tag": "7394feb1-3144-433b-bf8b-cff90d88c5fb"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:17.145360 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad269eaa-e5d0-4e84-be8a-e681956b185b service neutron] Pushing event updated for resources: {'Port': ['ID=7394feb1-3144-433b-bf8b-cff90d88c5fb,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:17.165588 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce937d66-0b6c-442e-8412-054a42a003b4 req-39efd0e8-da5b-4f59-8418-6eef147a27b0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.167117 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ce937d66-0b6c-442e-8412-054a42a003b4 req-39efd0e8-da5b-4f59-8418-6eef147a27b0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0867503 Sep 16 16:25:17.203652 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05b47bcc-9a3a-4678-9e5a-b250b39dfdc3 x-openstack-request-id: req-05b47bcc-9a3a-4678-9e5a-b250b39dfdc3 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:17.203967 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c71b7513-9f0d-4464-85af-085977775e81", "tag": "7394feb1-3144-433b-bf8b-cff90d88c5fb", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:17.204194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-05b47bcc-9a3a-4678-9e5a-b250b39dfdc3 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:17.204784 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c71b7513-9f0d-4464-85af-085977775e81', 'tag': '7394feb1-3144-433b-bf8b-cff90d88c5fb', 'status': 'completed', 'code': 200} Sep 16 16:25:17.244019 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ce937d66-0b6c-442e-8412-054a42a003b4 req-906dd0bc-f268-4916-bf43-666a68698cc4 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697787 Sep 16 16:25:17.255833 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-08b6a4cf-cb70-42f3-904a-e4ab50639b18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.257617 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-08b6a4cf-cb70-42f3-904a-e4ab50639b18 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=6560ff6c16c54d39bd054561aad63a12&device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 1096 time: 0.0671265 Sep 16 16:25:17.304736 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-1a7ed189-ef43-45a1-a2de-db4e36b3b098 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7394feb1-3144-433b-bf8b-cff90d88c5fb HTTP/1.1" status: 200 len: 217 time: 0.0374055 Sep 16 16:25:17.367902 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-1fe93cd9-59a0-4f40-877c-4be90ac10c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.369376 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-1fe93cd9-59a0-4f40-877c-4be90ac10c8a service neutron] 10.222.0.66 "GET /v2.0/subnets?id=dd7da63f-e08a-4fc1-87c9-93051b7a7b60 HTTP/1.1" status: 200 len: 853 time: 0.0579779 Sep 16 16:25:17.406337 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-b3066cab-7d93-4295-a2e8-e261f9157d0f service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=bbef521b-499c-40f5-ae34-4960093b92d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0276837 Sep 16 16:25:17.500957 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-ff9f5c3c-190c-477e-bc0b-5662f6e4b004 service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859306 Sep 16 16:25:17.618941 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-20fe0156-dd0e-4012-8b62-780dd0e4bebc service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1084309 Sep 16 16:25:17.717810 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-d008ad4b-c73d-4034-a50a-00c54e06a765 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.719341 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-d008ad4b-c73d-4034-a50a-00c54e06a765 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=6560ff6c16c54d39bd054561aad63a12&device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 1096 time: 0.0443647 Sep 16 16:25:17.813741 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-bf73e563-346a-4ffa-a43d-05056e2d968a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.815498 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-bf73e563-346a-4ffa-a43d-05056e2d968a service neutron] 10.222.0.66 "GET /v2.0/networks?id=bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 200 len: 914 time: 0.0870638 Sep 16 16:25:17.860697 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-abedb683-f70e-401d-94e5-f43ce9958b09 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7394feb1-3144-433b-bf8b-cff90d88c5fb HTTP/1.1" status: 200 len: 217 time: 0.0366204 Sep 16 16:25:17.924613 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-6b3d1a8b-e03d-4479-8cd6-8cd8740e6f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:17.926066 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-6b3d1a8b-e03d-4479-8cd6-8cd8740e6f73 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=dd7da63f-e08a-4fc1-87c9-93051b7a7b60 HTTP/1.1" status: 200 len: 853 time: 0.0536025 Sep 16 16:25:17.965116 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-eb295e8b-63bc-41ff-a4d2-dc6e87e8aa03 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=bbef521b-499c-40f5-ae34-4960093b92d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0300958 Sep 16 16:25:17.973544 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 40938) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:18.069446 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165f4788-00f7-411b-b323-6f89aad93e6e req-ca215bdd-41ae-415f-ab20-93080a60062f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:18.071494 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-165f4788-00f7-411b-b323-6f89aad93e6e req-ca215bdd-41ae-415f-ab20-93080a60062f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.1086156 Sep 16 16:25:18.103377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4a788525-9a42-4127-9ea6-3c8be7567a62 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.106692 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-365a6b7f-f025-4531-ac32-09d24a33b9a8 service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1183016 Sep 16 16:25:18.131558 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-165f4788-00f7-411b-b323-6f89aad93e6e req-04bf46ad-8163-4340-ade8-743a6a5a36b5 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539870 Sep 16 16:25:18.196749 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4a788525-9a42-4127-9ea6-3c8be7567a62 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.200786 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4a788525-9a42-4127-9ea6-3c8be7567a62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.207889 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e67055f1-2afb-4eb9-8cfd-3a6f842c52b5 req-34c94e9a-534f-460e-9232-300e8f3faff2 service neutron] 10.222.0.66 "GET /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909030 Sep 16 16:25:18.240524 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4a788525-9a42-4127-9ea6-3c8be7567a62 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=407e58c6da96489880f59b7fb84d505d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2658248 Sep 16 16:25:18.241391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a788525-9a42-4127-9ea6-3c8be7567a62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c30fefe3-a7a9-4ed6-a7ec-709964b0d33f,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:18.243259 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 40942) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:18.292804 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2278989e-3b9f-4d45-b2cd-0f927366a3de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.313873 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2278989e-3b9f-4d45-b2cd-0f927366a3de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.361024 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8911ed2e-c1da-4ed7-b754-eda26473b898 req-9ea1e49c-eeea-4183-b001-b6505b3d2e44 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:18.362967 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8911ed2e-c1da-4ed7-b754-eda26473b898 req-9ea1e49c-eeea-4183-b001-b6505b3d2e44 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0502021 Sep 16 16:25:18.364159 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2278989e-3b9f-4d45-b2cd-0f927366a3de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.367290 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2278989e-3b9f-4d45-b2cd-0f927366a3de admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:18.368629 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2278989e-3b9f-4d45-b2cd-0f927366a3de admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c30fefe3-a7a9-4ed6-a7ec-709964b0d33f HTTP/1.1" status: 204 len: 168 time: 0.1238153 Sep 16 16:25:18.378516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2278989e-3b9f-4d45-b2cd-0f927366a3de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c30fefe3-a7a9-4ed6-a7ec-709964b0d33f,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:18.440496 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8911ed2e-c1da-4ed7-b754-eda26473b898 req-44e57182-83b6-4660-ba6f-3a2ce1fbebec tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669458 Sep 16 16:25:19.140236 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-a0d50d56-80bc-4528-9e4c-f5a6f060f773 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:19.141705 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-a0d50d56-80bc-4528-9e4c-f5a6f060f773 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0570660 Sep 16 16:25:19.285573 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a6abab-68cc-47ad-b4c6-d3f2d5411ea5 req-bca85c06-fdbe-473d-8c33-981563ad3d41 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:19.287499 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d0a6abab-68cc-47ad-b4c6-d3f2d5411ea5 req-bca85c06-fdbe-473d-8c33-981563ad3d41 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 945 time: 0.0754566 Sep 16 16:25:19.290239 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Deleting port e42ecb5c-bf82-4da7-a301-2a3b2912db3d {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:19.290576 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:19.381308 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d0a6abab-68cc-47ad-b4c6-d3f2d5411ea5 req-454ee0d2-01ff-4016-9fbb-3f0244f00a9f tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/security-groups?id=b78095f5-08e4-4d5e-a244-cde8b0cc28b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763226 Sep 16 16:25:19.423957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] For port e42ecb5c-bf82-4da7-a301-2a3b2912db3d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:19.423957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:19.440439 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Calling delete_port for e42ecb5c-bf82-4da7-a301-2a3b2912db3d owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:19.579107 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe69e27f-a74d-4320-8988-b87d83d5771e req-f9796705-7f7f-4612-a490-3c0c9659a3e5 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:19.581607 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fe69e27f-a74d-4320-8988-b87d83d5771e req-f9796705-7f7f-4612-a490-3c0c9659a3e5 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0636637 Sep 16 16:25:19.602642 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:19.614944 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['e42ecb5c-bf82-4da7-a301-2a3b2912db3d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:25:19.654004 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fe69e27f-a74d-4320-8988-b87d83d5771e req-b11f0544-948e-48ea-ac49-ed7668489200 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609994 Sep 16 16:25:19.670796 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Pushing event deleted for resources: {'Port': ['ID=e42ecb5c-bf82-4da7-a301-2a3b2912db3d,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:19.693162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] No DVR routers for this DVR port e42ecb5c-bf82-4da7-a301-2a3b2912db3d on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:19.700214 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:19.702160 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dabe9377-0210-42b6-8b9b-001d6aefb6f5 req-32b9344a-073d-49b7-bea5-983701152ce9 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.66 "DELETE /v2.0/ports/e42ecb5c-bf82-4da7-a301-2a3b2912db3d HTTP/1.1" status: 204 len: 173 time: 0.5501978 Sep 16 16:25:19.702625 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'name': 'network-vif-deleted', 'tag': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:19.704858 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-924e4360-c139-46de-99b0-cd16ea3f6993" -d '{"events": [{"server_uuid": "4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d", "name": "network-vif-deleted", "tag": "e42ecb5c-bf82-4da7-a301-2a3b2912db3d"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:19.730759 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3c6bd989-cd31-460c-b00d-88af7100424f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1140710657&fields=id&tenant_id=3320c65285f54af487d03b845f596772 HTTP/1.1" status: 200 len: 267 time: 0.0630727 Sep 16 16:25:19.765144 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d391ea96-fa44-4ab6-ac0a-f21e46a15638 x-openstack-request-id: req-d391ea96-fa44-4ab6-ac0a-f21e46a15638 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:19.765441 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d", "name": "network-vif-deleted", "tag": "e42ecb5c-bf82-4da7-a301-2a3b2912db3d", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:19.765693 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-d391ea96-fa44-4ab6-ac0a-f21e46a15638 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:19.766081 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d', 'name': 'network-vif-deleted', 'tag': 'e42ecb5c-bf82-4da7-a301-2a3b2912db3d', 'status': 'completed', 'code': 200} Sep 16 16:25:19.854676 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-191008ee-7329-413c-bfbb-7c6502177901 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:19.856388 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-191008ee-7329-413c-bfbb-7c6502177901 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/networks?id=e657e2d9-d56a-46a2-987f-ea59605a973c HTTP/1.1" status: 200 len: 808 time: 0.1183224 Sep 16 16:25:19.873141 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-7bd00434-c343-41a4-81ea-1b39bfa70b8f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/quotas/3320c65285f54af487d03b845f596772 HTTP/1.1" status: 200 len: 375 time: 0.0107210 Sep 16 16:25:19.886340 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41014) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:19.931653 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-d5f538ca-774a-4cef-9e69-3914dab05e0a tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=3320c65285f54af487d03b845f596772&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0513797 Sep 16 16:25:19.998636 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0de62465-5311-4f21-b173-f08f7748de54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.039988 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-142851d9-ed1a-4e0d-9721-0135568abc65 service neutron] 10.222.0.59 "GET /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863938 Sep 16 16:25:20.089930 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0de62465-5311-4f21-b173-f08f7748de54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.094770 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0de62465-5311-4f21-b173-f08f7748de54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.133290 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0de62465-5311-4f21-b173-f08f7748de54 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=9675185b62244c19bc7a324f8d0b497b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2457862 Sep 16 16:25:20.134202 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de62465-5311-4f21-b173-f08f7748de54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3eea0da-91f1-4418-94ba-c5a203ea6320,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:20.136246 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41020) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:20.150163 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-f5cc58b4-976b-46b2-82ea-3bf6aa6486ec service neutron] 10.222.0.59 "GET /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036949 Sep 16 16:25:20.197105 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-22d3756f-fcd1-46e0-b106-e1b58fd1e784 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.221218 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-22d3756f-fcd1-46e0-b106-e1b58fd1e784 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.268559 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-22d3756f-fcd1-46e0-b106-e1b58fd1e784 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.271134 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-22d3756f-fcd1-46e0-b106-e1b58fd1e784 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.272446 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-22d3756f-fcd1-46e0-b106-e1b58fd1e784 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c3eea0da-91f1-4418-94ba-c5a203ea6320 HTTP/1.1" status: 204 len: 168 time: 0.1325519 Sep 16 16:25:20.280745 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d3756f-fcd1-46e0-b106-e1b58fd1e784 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3eea0da-91f1-4418-94ba-c5a203ea6320,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:20.498452 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-06852990-be56-4c36-9c90-53b744af924e req-2374e107-6792-4490-abdb-9e37bdc009ca tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 210 time: 0.0295992 Sep 16 16:25:20.521991 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d05fbfcb-4a27-4ae0-8fc0-10ca18dcd6aa req-fa1681e3-6e3c-421f-9494-e19d7fbd37c2 tempest-ServerRescueNegativeTestJSON-66897807 tempest-ServerRescueNegativeTestJSON-66897807-project] 10.222.0.59 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0482044 Sep 16 16:25:20.541763 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41044) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:20.620222 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41050) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:20.634506 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7c396ad4-f0be-4a2d-ba22-7ac06e28a6da admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.727254 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a0c4de47-f817-4102-91db-e79f604274ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.737685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7c396ad4-f0be-4a2d-ba22-7ac06e28a6da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.742013 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7c396ad4-f0be-4a2d-ba22-7ac06e28a6da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.780699 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7c396ad4-f0be-4a2d-ba22-7ac06e28a6da admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=9cbe9521e09641e5a25c1e2d55380bae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1592989 Sep 16 16:25:20.781565 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c396ad4-f0be-4a2d-ba22-7ac06e28a6da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=665e9244-c5ba-4728-b4e4-11fd19e8b125,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:20.783872 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41056) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:20.824272 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97d7e78-fbc8-4a73-ba01-59b45e7c8115 req-fab4e10b-7fba-42ad-a140-d09bce54a729 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:20.825841 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e97d7e78-fbc8-4a73-ba01-59b45e7c8115 req-fab4e10b-7fba-42ad-a140-d09bce54a729 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0973411 Sep 16 16:25:20.841890 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7cfa8dd6-fec0-4a1d-8743-46833196d5eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.876415 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7cfa8dd6-fec0-4a1d-8743-46833196d5eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.905695 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e97d7e78-fbc8-4a73-ba01-59b45e7c8115 req-7af197be-6cac-4ccb-b583-bd1a5ab4828e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699298 Sep 16 16:25:20.936733 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7cfa8dd6-fec0-4a1d-8743-46833196d5eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.939954 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7cfa8dd6-fec0-4a1d-8743-46833196d5eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:20.943749 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7cfa8dd6-fec0-4a1d-8743-46833196d5eb admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/665e9244-c5ba-4728-b4e4-11fd19e8b125 HTTP/1.1" status: 204 len: 168 time: 0.1563179 Sep 16 16:25:20.950873 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cfa8dd6-fec0-4a1d-8743-46833196d5eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=665e9244-c5ba-4728-b4e4-11fd19e8b125,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:21.097540 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:21.472582 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-2abbaa34-b369-4a1f-b5c7-5d03e74e3c59 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:21.474045 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-2abbaa34-b369-4a1f-b5c7-5d03e74e3c59 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.66 "GET /v2.0/networks?id=e657e2d9-d56a-46a2-987f-ea59605a973c HTTP/1.1" status: 200 len: 808 time: 0.1504192 Sep 16 16:25:21.490901 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Deleting port ed36e85b-3ccd-4d09-afaa-2def955b8b7c {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:21.491404 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:21.578516 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-147a0a04-9ae7-4200-ae40-cb02beb97fde tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3320c65285f54af487d03b845f596772 HTTP/1.1" status: 200 len: 380 time: 0.0841341 Sep 16 16:25:21.596762 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Request body: {'port': {'device_id': '9f3a81de-4d7d-4083-8698-fad6a3d5ce93', 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c', 'admin_state_up': True, 'tenant_id': '3320c65285f54af487d03b845f596772', 'security_groups': ['55cbc262-276f-4921-8e64-cd4fecacadec']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:21.608171 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4f40d7af-2340-4782-9564-3b1d3b4d33e5 req-d3495024-7ecb-48d9-8c41-321addf89f70 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 210 time: 0.0305851 Sep 16 16:25:21.646232 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] For port ed36e85b-3ccd-4d09-afaa-2def955b8b7c, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,segment=NetworkSegment(8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd),segment_id=8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:21.646624 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:21.692899 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Calling delete_port for ed36e85b-3ccd-4d09-afaa-2def955b8b7c owned by network:router_interface {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:21.786563 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Made reservation on behalf of 3320c65285f54af487d03b845f596772 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:25:21.790030 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.204836 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0994cc6-708d-486b-b4f8-47b045dd79d9 req-2298aec4-cf0e-4187-a9c0-e2bdc562a98e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:22.205718 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d0994cc6-708d-486b-b4f8-47b045dd79d9 req-2298aec4-cf0e-4187-a9c0-e2bdc562a98e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1288269 Sep 16 16:25:22.265196 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e42ecb5c-bf82-4da7-a301-2a3b2912db3d no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:22.285332 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: e42ecb5c-bf82-4da7-a301-2a3b2912db3d {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:22.285830 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device e42ecb5c-bf82-4da7-a301-2a3b2912db3d not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:22.286343 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:22.321251 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d0994cc6-708d-486b-b4f8-47b045dd79d9 req-1f56bfad-6a8e-4161-9854-8b01d0444236 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1043079 Sep 16 16:25:22.325855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.329089 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Allocated IP 172.20.0.12 (e657e2d9-d56a-46a2-987f-ea59605a973c/4b5db019-2ec2-4635-90ac-83301ff8e797/0512029c-9cdc-4ab9-8e37-52dc4f029dcc) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:22.360117 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Pushing event deleted for resources: {'Port': ['ID=ed36e85b-3ccd-4d09-afaa-2def955b8b7c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:22.391294 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.420513 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:22.423629 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ddcc5b1c-c4dc-471a-a1df-427f4323fcfa" -d '{"events": [{"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-unplugged", "status": "completed", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:22.442034 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:22.447396 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.474343 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b3574e7-0143-4d9f-a05d-aba9c81a9921 x-openstack-request-id: req-9b3574e7-0143-4d9f-a05d-aba9c81a9921 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:22.475093 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-unplugged", "status": "completed", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:22.475374 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-9b3574e7-0143-4d9f-a05d-aba9c81a9921 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:22.476324 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'code': 200} Sep 16 16:25:22.502607 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=6']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:22.509897 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.510329 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.510730 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.511362 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.511849 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.512180 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.512499 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.512981 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.513326 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.513655 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.513971 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.514456 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:25:22.625640 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.639810 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.731381 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0de6c59b-2cc9-4f77-b92d-28ee60e111a4 req-5089ef6c-b53e-4881-b450-fcb81d84c22c tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 210 time: 0.0412440 Sep 16 16:25:22.783098 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:22.839798 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Network e657e2d9-d56a-46a2-987f-ea59605a973c is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:22.845203 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:22.853574 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:22.883151 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event updated for resources: {'Port': ['ID=0512029c-9cdc-4ab9-8e37-52dc4f029dcc,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:22.957541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:22.958162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.022049 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-fe579023-9839-4b07-b50b-b0697793f29f tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4313598 Sep 16 16:25:23.037090 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Request body: {'port': {'device_id': '9f3a81de-4d7d-4083-8698-fad6a3d5ce93', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:23.070612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:25:23.102224 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-6c66f23a-6a62-4548-88b1-0fa65ba762f2 None None] Provisioning complete for port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:23.102589 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6c66f23a-6a62-4548-88b1-0fa65ba762f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.137705 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-6c66f23a-6a62-4548-88b1-0fa65ba762f2 None None] Port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:25:23.142052 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.287601 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:25:23.299040 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] Sync routers for ids ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:25:23.301935 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f2176ccc-8802-4edc-b006-ef63cedc2b81 admin admin] 10.222.0.59 "PUT /v2.0/routers/794079ca-8b9e-4ee4-9e49-75b36d31fc11/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7589910 Sep 16 16:25:23.305155 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41128) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:23.309926 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] Routers {'794079ca-8b9e-4ee4-9e49-75b36d31fc11'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:23.310617 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:24:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:23.449780 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks [] for router, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.459888 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f2cc658b-4e00-464d-a8f4-821401f33201 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.493496 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9be6264-d612-4015-9fe1-6cd00321555a req-57d29acc-d783-4649-b00d-4adfe8523e7f tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:23.495239 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d9be6264-d612-4015-9fe1-6cd00321555a req-57d29acc-d783-4649-b00d-4adfe8523e7f tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0984545 Sep 16 16:25:23.497818 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0512029c-9cdc-4ab9-8e37-52dc4f029dcc {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:25:23.506595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.521149 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] Set router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:23.521790 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Transition to ACTIVE for port object 0512029c-9cdc-4ab9-8e37-52dc4f029dcc will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:25:23.528374 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.590093 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Pushing event updated for resources: {'Port': ['ID=0512029c-9cdc-4ab9-8e37-52dc4f029dcc,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:23.712014 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Attempting to bind port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:23.712589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Attempting to bind port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:23.712682 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Attempting to bind port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc on network e657e2d9-d56a-46a2-987f-ea59605a973c {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:23.723039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc on network e657e2d9-d56a-46a2-987f-ea59605a973c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:25:23.723428 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Attempting to bind port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc on network e657e2d9-d56a-46a2-987f-ea59605a973c {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:23.729967 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.738190 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:23.738591 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Checking segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:23.740262 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Bound using segment: {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:23.740790 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Bound port: 0512029c-9cdc-4ab9-8e37-52dc4f029dcc, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7bdee358-0ffe-449a-8264-a3184229e5b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 718, 'network_id': 'e657e2d9-d56a-46a2-987f-ea59605a973c'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:23.741551 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.757880 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:25:22Z', 'revision_number': 5, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:23.810874 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] Checking router: 794079ca-8b9e-4ee4-9e49-75b36d31fc11 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:25:23.820180 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] Routers {'794079ca-8b9e-4ee4-9e49-75b36d31fc11'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:23.820709 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:23.823858 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d9be6264-d612-4015-9fe1-6cd00321555a req-1462d7c5-a1ab-4155-bf65-33c0f366d872 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3185368 Sep 16 16:25:23.844526 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] For port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:23.844526 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] For port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=0512029c-9cdc-4ab9-8e37-52dc4f029dcc,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:23.845521 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.859334 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.912404 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Deleting port a72418ec-cdf5-4bb6-bd12-2486cbdc867d {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:23.913025 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.924635 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:23.925262 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:23.927064 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] 10.222.0.66 "PUT /v2.0/ports/0512029c-9cdc-4ab9-8e37-52dc4f029dcc HTTP/1.1" status: 200 len: 1094 time: 0.8941646 Sep 16 16:25:23.930180 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f3a81de-4d7d-4083-8698-fad6a3d5ce93', 'tag': '0512029c-9cdc-4ab9-8e37-52dc4f029dcc'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:23.942511 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abd03d23-5340-417a-91f2-05f382598586" -d '{"events": [{"name": "network-changed", "server_uuid": "9f3a81de-4d7d-4083-8698-fad6a3d5ce93", "tag": "0512029c-9cdc-4ab9-8e37-52dc4f029dcc"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:23.983863 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] Set router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:24.032512 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2941fc-2fa5-414a-bfa1-7554bb4c8387 req-54ff4ad6-2d07-4d98-ad0e-dd3100350136 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.032863 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] For port a72418ec-cdf5-4bb6-bd12-2486cbdc867d, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:24.033258 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.034029 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8c2941fc-2fa5-414a-bfa1-7554bb4c8387 req-54ff4ad6-2d07-4d98-ad0e-dd3100350136 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 944 time: 0.1898787 Sep 16 16:25:24.050186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe2f2b47-1988-411e-9f59-66d27b6e47a1 x-openstack-request-id: req-fe2f2b47-1988-411e-9f59-66d27b6e47a1 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:24.050482 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9f3a81de-4d7d-4083-8698-fad6a3d5ce93", "tag": "0512029c-9cdc-4ab9-8e37-52dc4f029dcc", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:24.050737 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-fe2f2b47-1988-411e-9f59-66d27b6e47a1 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:24.051128 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f3a81de-4d7d-4083-8698-fad6a3d5ce93', 'tag': '0512029c-9cdc-4ab9-8e37-52dc4f029dcc', 'status': 'completed', 'code': 200} Sep 16 16:25:24.064301 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Calling delete_port for a72418ec-cdf5-4bb6-bd12-2486cbdc867d owned by network:router_gateway {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:24.067942 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7533c8-6df0-408c-8c54-17291c49faca service neutron] Pushing event updated for resources: {'Port': ['ID=0512029c-9cdc-4ab9-8e37-52dc4f029dcc,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:24.113992 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8c2941fc-2fa5-414a-bfa1-7554bb4c8387 req-76a84902-8f08-4a5e-94f3-0447b4c88b30 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/security-groups?id=55cbc262-276f-4921-8e64-cd4fecacadec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601003 Sep 16 16:25:24.116980 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4109ffc2-460c-4662-9b1a-0fae6a7d5c3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.118439 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4109ffc2-460c-4662-9b1a-0fae6a7d5c3b service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=3320c65285f54af487d03b845f596772&device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 1097 time: 0.1312385 Sep 16 16:25:24.183269 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-5088a39f-14b8-4377-9e3b-6c431a82e344 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0512029c-9cdc-4ab9-8e37-52dc4f029dcc HTTP/1.1" status: 200 len: 217 time: 0.0552008 Sep 16 16:25:24.270158 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-cd3b05d5-923c-4586-b15e-755d81292d4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.272082 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-cd3b05d5-923c-4586-b15e-755d81292d4b service neutron] 10.222.0.66 "GET /v2.0/subnets?id=4b5db019-2ec2-4635-90ac-83301ff8e797 HTTP/1.1" status: 200 len: 847 time: 0.0816343 Sep 16 16:25:24.314654 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:25:22Z', 'revision_number': 5, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:24.323790 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.356552 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-644fa0df-38b9-4fdb-ba7f-0b22e214df66 None None] The sync data for ids ['794079ca-8b9e-4ee4-9e49-75b36d31fc11'] in dv-cinder-805887-15-iscsi is: [{'id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'name': 'tempest-ServerRescueNegativeTestJSON-164939515-router', 'tenant_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:25:22Z', 'revision_number': 5, 'project_id': 'edfe8167ea8b4027bb39f6b5ad4d2c57', 'gw_port': {'id': 'a72418ec-cdf5-4bb6-bd12-2486cbdc867d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:0a:95:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '794079ca-8b9e-4ee4-9e49-75b36d31fc11', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:00Z', 'updated_at': '2021-09-16T16:22:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:25:24.359167 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-38567b06-b744-4989-aacb-8adc8489ffc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.363831 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Pushing event deleted for resources: {'Port': ['ID=a72418ec-cdf5-4bb6-bd12-2486cbdc867d,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:24.365056 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-38567b06-b744-4989-aacb-8adc8489ffc1 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e657e2d9-d56a-46a2-987f-ea59605a973c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0776837 Sep 16 16:25:24.365299 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.489621 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.498511 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-0693ae42-f262-44eb-a750-49966329c70d service neutron] 10.222.0.66 "GET /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1239285 Sep 16 16:25:24.598826 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-33613cf2-6bd4-4af7-baaa-e0c99b1a9b91 service neutron] 10.222.0.66 "GET /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934160 Sep 16 16:25:24.601786 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.604115 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.669520 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.669926 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 794079ca-8b9e-4ee4-9e49-75b36d31fc11 {{(pid=93950) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:25:24.674938 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.676112 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-66d0136b-c665-4961-b340-b91c7b7e7971 admin admin] 10.222.0.59 "DELETE /v2.0/routers/794079ca-8b9e-4ee4-9e49-75b36d31fc11 HTTP/1.1" status: 204 len: 168 time: 1.3695109 Sep 16 16:25:24.678653 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41152) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:24.694541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd03d23-5340-417a-91f2-05f382598586 req-63f9ce73-2d42-4404-bc69-5fb684861e61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.696484 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-63f9ce73-2d42-4404-bc69-5fb684861e61 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=3320c65285f54af487d03b845f596772&device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 1097 time: 0.0418296 Sep 16 16:25:24.724255 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Deleting subnet c1936e4e-27dd-43b2-be4a-1bdf226e79cc {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:25:24.728008 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.764326 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.796804 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd03d23-5340-417a-91f2-05f382598586 req-b27bdf44-7bff-453a-9fe6-02f1a077d5f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.798404 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-b27bdf44-7bff-453a-9fe6-02f1a077d5f8 service neutron] 10.222.0.66 "GET /v2.0/networks?id=e657e2d9-d56a-46a2-987f-ea59605a973c HTTP/1.1" status: 200 len: 909 time: 0.0939262 Sep 16 16:25:24.809848 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.848453 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-ed92490d-1eea-498f-abfb-ac59c162b673 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0512029c-9cdc-4ab9-8e37-52dc4f029dcc HTTP/1.1" status: 200 len: 217 time: 0.0346048 Sep 16 16:25:24.869644 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.897017 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c1936e4e-27dd-43b2-be4a-1bdf226e79cc,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:24.908022 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:24.908877 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd03d23-5340-417a-91f2-05f382598586 req-cdd69734-361a-4225-ad71-d0f5eb29221c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.911276 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-c22d75f0-6540-4932-b8fb-e2a886128063 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/c1936e4e-27dd-43b2-be4a-1bdf226e79cc HTTP/1.1" status: 204 len: 168 time: 0.2301154 Sep 16 16:25:24.911417 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-cdd69734-361a-4225-ad71-d0f5eb29221c service neutron] 10.222.0.66 "GET /v2.0/subnets?id=4b5db019-2ec2-4635-90ac-83301ff8e797 HTTP/1.1" status: 200 len: 847 time: 0.0511842 Sep 16 16:25:24.912643 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41156) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:24.964493 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6894ec0-29dc-4e60-a86c-762ffcce9d44 req-72ab52fd-a7b5-4a74-a6ce-035ab45bf4cb tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:24.965986 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f6894ec0-29dc-4e60-a86c-762ffcce9d44 req-72ab52fd-a7b5-4a74-a6ce-035ab45bf4cb tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0493240 Sep 16 16:25:24.979699 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.005119 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f6894ec0-29dc-4e60-a86c-762ffcce9d44 req-ff35a186-34c0-4d4c-b8a3-de41f174b73a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326867 Sep 16 16:25:25.087938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.108324 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['53267936-cd43-4d76-85cb-9474bc332b78']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:25.117935 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:25.119554 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f433e6d-cf82-40a5-bc5c-f3f2ff7e31fd') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:25.130438 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.149673 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.156522 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Releasing vlan 721 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:25:25.157060 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:25:25.158701 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:25:25.236410 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.245292 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.249565 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] 10.222.0.59 "DELETE /v2.0/networks/53267936-cd43-4d76-85cb-9474bc332b78 HTTP/1.1" status: 204 len: 168 time: 0.3354826 Sep 16 16:25:25.261884 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe62d98-d221-4e95-affe-766aa2ecd06b admin admin] Pushing event deleted for resources: {'Network': ['ID=53267936-cd43-4d76-85cb-9474bc332b78,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:25.277068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28036a2e-631d-4a10-a28e-c6eceb47534e req-cc2774b0-2f72-4283-b0bd-25e21d749e14 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:25.278690 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-28036a2e-631d-4a10-a28e-c6eceb47534e req-cc2774b0-2f72-4283-b0bd-25e21d749e14 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 944 time: 0.0777988 Sep 16 16:25:25.319269 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-28036a2e-631d-4a10-a28e-c6eceb47534e req-c19fdb0d-b713-497e-a42a-0d49752d9c1d tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/security-groups?id=55cbc262-276f-4921-8e64-cd4fecacadec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334842 Sep 16 16:25:25.422542 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41162) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:25.466911 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41164) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:25.468109 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-6abad391-b016-425a-a8ef-e68d5b4e9bc6 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0441086 Sep 16 16:25:25.519853 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-796f6ae8-3da6-4af6-9a6e-169271108d51 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.555753 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-796f6ae8-3da6-4af6-9a6e-169271108d51 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.604618 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-796f6ae8-3da6-4af6-9a6e-169271108d51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.607464 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-796f6ae8-3da6-4af6-9a6e-169271108d51 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:25.608660 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-796f6ae8-3da6-4af6-9a6e-169271108d51 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b78095f5-08e4-4d5e-a244-cde8b0cc28b3 HTTP/1.1" status: 204 len: 168 time: 0.1407526 Sep 16 16:25:25.616863 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796f6ae8-3da6-4af6-9a6e-169271108d51 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b78095f5-08e4-4d5e-a244-cde8b0cc28b3,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:25.756200 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device ed36e85b-3ccd-4d09-afaa-2def955b8b7c no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:25.777163 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: ed36e85b-3ccd-4d09-afaa-2def955b8b7c {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:25.777397 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device ed36e85b-3ccd-4d09-afaa-2def955b8b7c not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:25.777801 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device a72418ec-cdf5-4bb6-bd12-2486cbdc867d no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:25.801800 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: a72418ec-cdf5-4bb6-bd12-2486cbdc867d {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:25.802153 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device a72418ec-cdf5-4bb6-bd12-2486cbdc867d not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:25.918198 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd03d23-5340-417a-91f2-05f382598586 req-387cc223-9b8b-4d3f-8609-b1aa69e10637 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:25.919720 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-387cc223-9b8b-4d3f-8609-b1aa69e10637 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e657e2d9-d56a-46a2-987f-ea59605a973c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0555820 Sep 16 16:25:26.139145 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7371cbe-e774-4c07-a182-f36526d902e1 req-d37f3365-b6b8-46fd-814d-47da4ae05a3d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:26.145255 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c7371cbe-e774-4c07-a182-f36526d902e1 req-d37f3365-b6b8-46fd-814d-47da4ae05a3d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0623841 Sep 16 16:25:26.186004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.192907 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c7371cbe-e774-4c07-a182-f36526d902e1 req-1140ca68-094f-408c-834f-1e0a9a8c43f0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416629 Sep 16 16:25:26.354429 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41236) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:26.442070 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b34c320-5aab-4c84-929a-34b67d985f3f req-ac2bfd83-8bcc-41a0-b9f5-4d28f91fe5fc tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:26.446264 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6b34c320-5aab-4c84-929a-34b67d985f3f req-ac2bfd83-8bcc-41a0-b9f5-4d28f91fe5fc tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 944 time: 0.0542717 Sep 16 16:25:26.468853 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-network', 'tenant_id': 'bafa01935144486cb747380ee210ccb9'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:26.497794 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6b34c320-5aab-4c84-929a-34b67d985f3f req-f20b5f1e-6d2d-4d51-b7ca-95d7e6454dca tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/security-groups?id=55cbc262-276f-4921-8e64-cd4fecacadec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464892 Sep 16 16:25:26.506077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Made reservation on behalf of bafa01935144486cb747380ee210ccb9 for: {'network': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:25:26.509769 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.520352 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.613663 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.617558 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.641281 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 709} {{(pid=93951) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:25:26.651825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe33d266-87f2-4d16-bde6-2eee6a0f0794,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:26.657758 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.658098 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.segments_db [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Added segment 4c0fb585-da88-48c0-976a-40a4f44418a6 of type vlan for network 2577e213-c4cb-4026-ab97-83e15eeef39e Sep 16 16:25:26.696952 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.747484 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.748404 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:26.748978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.812606 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.4574869 Sep 16 16:25:26.815758 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41248) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:26.820709 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Request body: {'subnet': {'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-subnet', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:26.842590 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Made reservation on behalf of bafa01935144486cb747380ee210ccb9 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:25:26.844890 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64151728'] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:26.851563 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b43526-2413-4ff5-a684-f59d6f621806 admin admin] Pushing event updated for resources: {'Network': ['ID=2577e213-c4cb-4026-ab97-83e15eeef39e,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:26.862648 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 2577e213-c4cb-4026-ab97-83e15eeef39e details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:25:26.869849 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-5ed8624c-8910-465c-8e6f-a450b2d4305f service neutron] 10.222.0.66 "GET /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1573362 Sep 16 16:25:27.020793 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-65205906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64151710'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.050647 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:25:27.074238 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=12487de4-e994-4284-8ca2-3e5c64dab8fe,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:27.082892 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Checking segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:27.083292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Network hostable DHCP agents. Network: 2577e213-c4cb-4026-ab97-83e15eeef39e, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:25:27.099253 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Network 2577e213-c4cb-4026-ab97-83e15eeef39e is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:25:27.107290 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 2577e213-c4cb-4026-ab97-83e15eeef39e) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:27.111125 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:27.111745 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.116197 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47fb6b7a-aa3f-4cf5-a9ce-38c7389ae89c None None] Network 2577e213-c4cb-4026-ab97-83e15eeef39e requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:25:27.126198 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e7262c0b-2507-4be4-b5bf-a6a867d870fc admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.3093400 Sep 16 16:25:27.128913 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41250) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:27.133599 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:27.152985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.153946 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.207166 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.263955 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-2577e213-c4cb-4026-ab97-83e15eeef39e', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'fixed_ips': [{'subnet_id': '12487de4-e994-4284-8ca2-3e5c64dab8fe'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:25:27.265038 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.384301 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.400745 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Allocated IP 172.20.0.2 (2577e213-c4cb-4026-ab97-83e15eeef39e/12487de4-e994-4284-8ca2-3e5c64dab8fe/13ad372b-991b-4e2b-a181-4cd4b4a3eda2) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:27.418190 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31096b59-487f-49c9-898b-aa13a5366c10 req-759eebff-f4c6-4282-a86f-8c4fe675fd0d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:27.419701 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-31096b59-487f-49c9-898b-aa13a5366c10 req-759eebff-f4c6-4282-a86f-8c4fe675fd0d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1372330 Sep 16 16:25:27.488317 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-31096b59-487f-49c9-898b-aa13a5366c10 req-d9fc7714-b43e-4596-aabd-c804231c1e01 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620754 Sep 16 16:25:27.551174 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.558721 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.596925 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Network 2577e213-c4cb-4026-ab97-83e15eeef39e is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:27.601346 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:27.605249 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:27.629419 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.636585 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05c69aa-e42c-4bb7-833a-e338b9dbcdef req-c4f29cd4-d1f6-4070-ab66-834a01924b2b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:27.637646 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Pushing event updated for resources: {'Port': ['ID=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:27.639314 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d05c69aa-e42c-4bb7-833a-e338b9dbcdef req-c4f29cd4-d1f6-4070-ab66-834a01924b2b tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 944 time: 0.0570097 Sep 16 16:25:27.653641 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.682461 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Attempting to bind port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:27.682461 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Attempting to bind port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:27.682794 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Attempting to bind port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 on network 2577e213-c4cb-4026-ab97-83e15eeef39e {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:27.690645 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:27.691030 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Checking segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:27.691465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.691860 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Bound using segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:27.692325 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Bound port: 13ad372b-991b-4e2b-a181-4cd4b4a3eda2, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:27.692709 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.693730 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d05c69aa-e42c-4bb7-833a-e338b9dbcdef req-1f4c8289-b490-4716-a432-aa8f42e103f3 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/security-groups?id=55cbc262-276f-4921-8e64-cd4fecacadec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457137 Sep 16 16:25:27.763200 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] For port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:27.766194 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] For port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:27.766415 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Allocated IP 172.27.3.14 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/202f08bf-86f8-4762-b351-62fe1969aa8b) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:27.770467 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.811230 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-abd03d23-5340-417a-91f2-05f382598586 req-c9dae869-2df5-4b28-96e6-6f89168550e7 service neutron] 10.222.0.66 "GET /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045806 Sep 16 16:25:27.835605 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-656031f0-4e97-4666-9b36-f285b3e13b03 None None] Pushing event updated for resources: {'Port': ['ID=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:27.886500 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.924045 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:27.962907 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:27.966420 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:27.969937 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:28.006878 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Pushing event updated for resources: {'Port': ['ID=202f08bf-86f8-4762-b351-62fe1969aa8b,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:28.243587 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:28.468888 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:28.771120 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff21d0-4063-4783-8126-904a333e5ecf req-0c4f57db-e420-4e6f-89ab-b33861615dfa tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:28.774561 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-0c4f57db-e420-4e6f-89ab-b33861615dfa tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.66 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 944 time: 0.3547189 Sep 16 16:25:28.802871 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8be26b50-7c45-490c-8568-f8714e39620a None None] Network 2577e213-c4cb-4026-ab97-83e15eeef39e requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:25:28.893697 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e3d5031-9821-4533-a457-a66cc4e58619 req-e63ce157-3a7c-453f-985b-7baa03bb5304 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:28.893697 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9e3d5031-9821-4533-a457-a66cc4e58619 req-e63ce157-3a7c-453f-985b-7baa03bb5304 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.3256118 Sep 16 16:25:28.912149 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Router d52237e7-3781-41ad-9236-c7e649e67a9d is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93950) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:25:28.953013 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9e3d5031-9821-4533-a457-a66cc4e58619 req-d9c040e0-85c3-401d-bd9b-8da23aa1739b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496874 Sep 16 16:25:28.956811 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a88c210-bc80-49be-aa68-9551a35c0771 req-a5919645-5fac-4911-8c63-d2d7cfe61184 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:28.961820 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8a88c210-bc80-49be-aa68-9551a35c0771 req-a5919645-5fac-4911-8c63-d2d7cfe61184 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 944 time: 0.1462622 Sep 16 16:25:28.995590 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Deleting port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:28.996000 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.018170 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-de2d4b46-685e-43d5-9bcc-19ffc4ae26d6 None None] Provisioning complete for port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:29.027771 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-de2d4b46-685e-43d5-9bcc-19ffc4ae26d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.087087 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:25:29.103135 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] For port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=0512029c-9cdc-4ab9-8e37-52dc4f029dcc,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:29.103550 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.104710 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Sync routers for ids ['d52237e7-3781-41ad-9236-c7e649e67a9d'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:25:29.110140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.117959 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-002f5401-3ea3-4e3a-a59d-2d0e18e44386 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 1.9879513 Sep 16 16:25:29.118701 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41286) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:29.119834 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41288) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:29.145755 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Routers {'d52237e7-3781-41ad-9236-c7e649e67a9d'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:29.146398 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['d52237e7-3781-41ad-9236-c7e649e67a9d'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:29.190253 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Calling delete_port for 0512029c-9cdc-4ab9-8e37-52dc4f029dcc owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:29.194883 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8a88c210-bc80-49be-aa68-9551a35c0771 req-1932c567-cd78-4e05-9d75-df322703a3e4 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/security-groups?id=55cbc262-276f-4921-8e64-cd4fecacadec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2188010 Sep 16 16:25:29.313407 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-de2d4b46-685e-43d5-9bcc-19ffc4ae26d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.322455 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5663028c-8dbe-4915-9358-1f04875e479e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.365405 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Set router d52237e7-3781-41ad-9236-c7e649e67a9d gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:29.444725 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.466471 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5663028c-8dbe-4915-9358-1f04875e479e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.472140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5663028c-8dbe-4915-9358-1f04875e479e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.488072 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-de2d4b46-685e-43d5-9bcc-19ffc4ae26d6 None None] For port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:29.505321 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-de2d4b46-685e-43d5-9bcc-19ffc4ae26d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.519296 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event deleted for resources: {'Port': ['ID=0512029c-9cdc-4ab9-8e37-52dc4f029dcc,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:29.521183 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5663028c-8dbe-4915-9358-1f04875e479e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3dc7555-51df-4a51-8067-b3526e3ac9d7,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:29.543460 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5663028c-8dbe-4915-9358-1f04875e479e admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=01a65938e43146899f0c7a8ca89f5849&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4225116 Sep 16 16:25:29.546073 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41296) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:29.572579 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2d4b46-685e-43d5-9bcc-19ffc4ae26d6 None None] Pushing event updated for resources: {'Port': ['ID=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:29.583904 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] No DVR routers for this DVR port 0512029c-9cdc-4ab9-8e37-52dc4f029dcc on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:29.590166 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.592176 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-4b28faa4-dc88-4e88-b983-0be359175bd9 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.66 "DELETE /v2.0/ports/0512029c-9cdc-4ab9-8e37-52dc4f029dcc HTTP/1.1" status: 204 len: 173 time: 0.8090529 Sep 16 16:25:29.592801 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f3a81de-4d7d-4083-8698-fad6a3d5ce93', 'name': 'network-vif-deleted', 'tag': '0512029c-9cdc-4ab9-8e37-52dc4f029dcc'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:29.595260 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b223d2e-378d-4006-b3dd-9483d12cabfe" -d '{"events": [{"server_uuid": "9f3a81de-4d7d-4083-8698-fad6a3d5ce93", "name": "network-vif-deleted", "tag": "0512029c-9cdc-4ab9-8e37-52dc4f029dcc"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:29.619351 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8b3ed2d6-e4a8-4b02-a8fe-76ffc588fd13 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.676603 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f02d6164-0c0b-4a98-9682-75490a077e02 x-openstack-request-id: req-f02d6164-0c0b-4a98-9682-75490a077e02 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:29.678220 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f3a81de-4d7d-4083-8698-fad6a3d5ce93", "name": "network-vif-deleted", "tag": "0512029c-9cdc-4ab9-8e37-52dc4f029dcc", "status": "failed", "code": 422}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:29.680972 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-f02d6164-0c0b-4a98-9682-75490a077e02 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:29.681708 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '9f3a81de-4d7d-4083-8698-fad6a3d5ce93', 'name': 'network-vif-deleted', 'tag': '0512029c-9cdc-4ab9-8e37-52dc4f029dcc', 'status': 'failed', 'code': 422} returned with failed status Sep 16 16:25:29.689640 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-682be112-c720-4d98-8c6e-0f03a4bf2644 None None] Provisioning complete for port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:29.690042 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-682be112-c720-4d98-8c6e-0f03a4bf2644 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.701563 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8b3ed2d6-e4a8-4b02-a8fe-76ffc588fd13 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.832047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8b3ed2d6-e4a8-4b02-a8fe-76ffc588fd13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.836861 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8b3ed2d6-e4a8-4b02-a8fe-76ffc588fd13 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:29.842565 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-8b3ed2d6-e4a8-4b02-a8fe-76ffc588fd13 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c3dc7555-51df-4a51-8067-b3526e3ac9d7 HTTP/1.1" status: 204 len: 168 time: 0.2952778 Sep 16 16:25:29.864165 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3ed2d6-e4a8-4b02-a8fe-76ffc588fd13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3dc7555-51df-4a51-8067-b3526e3ac9d7,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:29.972389 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:25:30.110521 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41312) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:30.132594 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.134081 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:30.134451 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.151012 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-30ff21d0-4063-4783-8126-904a333e5ecf req-3d94cb2e-2775-4b13-b408-0db6cca18b62 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 210 time: 0.0388858 Sep 16 16:25:30.157942 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b630a959-2db2-4c6d-9b2b-2e56f19fb124 req-939f8b71-f972-44de-a4b5-cf8e982c9f45 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:30.159492 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b630a959-2db2-4c6d-9b2b-2e56f19fb124 req-939f8b71-f972-44de-a4b5-cf8e982c9f45 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1059256 Sep 16 16:25:30.228564 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:28Z', 'revision_number': 3, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:30.289922 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b630a959-2db2-4c6d-9b2b-2e56f19fb124 req-888c31f3-dd62-4344-b22b-9b909b9dcb48 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876343 Sep 16 16:25:30.336713 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Checking router: d52237e7-3781-41ad-9236-c7e649e67a9d for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:25:30.337273 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Updating router d52237e7-3781-41ad-9236-c7e649e67a9d port 202f08bf-86f8-4762-b351-62fe1969aa8b binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:25:30.339604 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-35bdc968-151c-4e93-9d9a-c8489b681d6f req-9933b3f9-274c-4bdf-8c57-ad86def59682 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 210 time: 0.0412717 Sep 16 16:25:30.351567 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Allocated IP 172.20.0.1 (2577e213-c4cb-4026-ab97-83e15eeef39e/12487de4-e994-4284-8ca2-3e5c64dab8fe/f457f757-3e3b-4e45-9016-a30d2863653c) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:30.353614 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41318) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:30.368274 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-608db5dd-6819-4d89-bd12-594d35c74c85 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.385398 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.469280 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-608db5dd-6819-4d89-bd12-594d35c74c85 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.474412 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-608db5dd-6819-4d89-bd12-594d35c74c85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.503984 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b55eb555-7926-4667-b6b0-fc0f2a014d72 req-6fc9d230-ae37-42c7-9e8b-e29906ab9110 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "GET /v2.0/ports?device_id=9f3a81de-4d7d-4083-8698-fad6a3d5ce93 HTTP/1.1" status: 200 len: 210 time: 0.0353022 Sep 16 16:25:30.509466 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.517284 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-608db5dd-6819-4d89-bd12-594d35c74c85 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=754bd4dce3de4a68ae93a14897ae3d79&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1626012 Sep 16 16:25:30.518264 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-608db5dd-6819-4d89-bd12-594d35c74c85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60158be8-2aa2-46df-9188-887645da961f,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:30.520727 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41320) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:30.555929 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.585047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2bd755a5-d21a-49c9-927e-75c40f269962 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.600200 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Network 2577e213-c4cb-4026-ab97-83e15eeef39e is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:30.603905 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:30.607798 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:30.608094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2bd755a5-d21a-49c9-927e-75c40f269962 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.643595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Pushing event updated for resources: {'Port': ['ID=f457f757-3e3b-4e45-9016-a30d2863653c,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:30.660787 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.671242 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2bd755a5-d21a-49c9-927e-75c40f269962 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.675141 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2bd755a5-d21a-49c9-927e-75c40f269962 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.676536 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-2bd755a5-d21a-49c9-927e-75c40f269962 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/60158be8-2aa2-46df-9188-887645da961f HTTP/1.1" status: 204 len: 168 time: 0.1548462 Sep 16 16:25:30.694193 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd755a5-d21a-49c9-927e-75c40f269962 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60158be8-2aa2-46df-9188-887645da961f,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:30.752836 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.765453 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.834921 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.839468 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Attempting to bind port 202f08bf-86f8-4762-b351-62fe1969aa8b on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:30.839838 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Attempting to bind port 202f08bf-86f8-4762-b351-62fe1969aa8b by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:30.840199 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Attempting to bind port 202f08bf-86f8-4762-b351-62fe1969aa8b on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:30.853059 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:30.853458 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:30.853862 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.854251 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:30.854771 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Bound port: 202f08bf-86f8-4762-b351-62fe1969aa8b, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:30.855152 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.920443 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] For port 202f08bf-86f8-4762-b351-62fe1969aa8b, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:30.924251 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] For port 202f08bf-86f8-4762-b351-62fe1969aa8b, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=202f08bf-86f8-4762-b351-62fe1969aa8b,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:30.932180 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-335c23d3-9650-44f7-beb3-fb2483168f60 None None] Pushing event updated for resources: {'Port': ['ID=202f08bf-86f8-4762-b351-62fe1969aa8b,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:30.936482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:30.998827 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Routers {'d52237e7-3781-41ad-9236-c7e649e67a9d'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:30.999579 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['d52237e7-3781-41ad-9236-c7e649e67a9d'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:31.050075 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.061957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.064085 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-c70f0bd2-e63a-4186-96e1-70130049a104 None None] Provisioning complete for port f457f757-3e3b-4e45-9016-a30d2863653c triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:31.064717 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c70f0bd2-e63a-4186-96e1-70130049a104 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.090928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-335c23d3-9650-44f7-beb3-fb2483168f60 None None] Pushing event updated for resources: {'Port': ['ID=202f08bf-86f8-4762-b351-62fe1969aa8b,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:31.168083 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Pushing event updated for resources: {'Port': ['ID=f457f757-3e3b-4e45-9016-a30d2863653c,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:31.177105 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.182288 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-c70f0bd2-e63a-4186-96e1-70130049a104 None None] Port f457f757-3e3b-4e45-9016-a30d2863653c cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:25:31.246464 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] Set router d52237e7-3781-41ad-9236-c7e649e67a9d gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:31.312980 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Network 2577e213-c4cb-4026-ab97-83e15eeef39e is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:31.314705 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:31.363340 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41358) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:31.477964 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3c1ba688-cfbd-42bf-ae3c-00c017889010 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.515806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3c1ba688-cfbd-42bf-ae3c-00c017889010 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.585835 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Router d52237e7-3781-41ad-9236-c7e649e67a9d has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:25:31.598494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3c1ba688-cfbd-42bf-ae3c-00c017889010 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.601224 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3c1ba688-cfbd-42bf-ae3c-00c017889010 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.604868 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3c1ba688-cfbd-42bf-ae3c-00c017889010 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] 10.222.0.59 "DELETE /v2.0/security-groups/55cbc262-276f-4921-8e64-cd4fecacadec HTTP/1.1" status: 204 len: 168 time: 0.2385540 Sep 16 16:25:31.605126 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f457f757-3e3b-4e45-9016-a30d2863653c', 'name': '', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'mac_address': 'fa:16:3e:43:cf:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_interface', 'standard_attr_id': 493, 'fixed_ips': [{'subnet_id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:30Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 1, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'subnets': [{'id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:31.619454 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1ba688-cfbd-42bf-ae3c-00c017889010 tempest-TestShelveInstance-376232198 tempest-TestShelveInstance-376232198-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=55cbc262-276f-4921-8e64-cd4fecacadec,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:31.621138 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8939e9b3-1218-4133-90d4-9e60adfad8a5 req-0b6c0754-8f6c-4d29-8f30-6ef09389a201 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:31.622744 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8939e9b3-1218-4133-90d4-9e60adfad8a5 req-0b6c0754-8f6c-4d29-8f30-6ef09389a201 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1961558 Sep 16 16:25:31.643153 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efbbe9c9-d712-4f11-923c-e9a4f0bb0de2 None None] The sync data for ids ['d52237e7-3781-41ad-9236-c7e649e67a9d'] in dv-cinder-805887-15-iscsi is: [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f457f757-3e3b-4e45-9016-a30d2863653c', 'name': '', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'mac_address': 'fa:16:3e:43:cf:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_interface', 'standard_attr_id': 493, 'fixed_ips': [{'subnet_id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:30Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 1, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'subnets': [{'id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:25:31.653101 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-859897a5-90c9-4dec-a816-58b113d41c00 None None] Provisioning complete for port f457f757-3e3b-4e45-9016-a30d2863653c triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:31.654643 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-859897a5-90c9-4dec-a816-58b113d41c00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:31.705597 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-859897a5-90c9-4dec-a816-58b113d41c00 None None] Port f457f757-3e3b-4e45-9016-a30d2863653c cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:25:31.734058 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41372) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:31.745544 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8939e9b3-1218-4133-90d4-9e60adfad8a5 req-d49336e5-504c-4df1-b1e4-199248155c00 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625598 Sep 16 16:25:31.809350 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:25:31.820845 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2bb3a964-f60c-4c1c-b29e-92077c89b534 admin admin] 10.222.0.59 "PUT /v2.0/routers/d52237e7-3781-41ad-9236-c7e649e67a9d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6954644 Sep 16 16:25:32.236113 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.582605 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41400) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:32.600056 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2013404473', 'description': 'tempest-description--597483884'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:32.634532 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.650692 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Deleting port f410a660-bea0-4ae7-868b-9db8e0cc0c45 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:32.651282 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.754661 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.759051 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.764994 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] For port f410a660-bea0-4ae7-868b-9db8e0cc0c45, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=f410a660-bea0-4ae7-868b-9db8e0cc0c45,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:32.765363 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.779776 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Calling delete_port for f410a660-bea0-4ae7-868b-9db8e0cc0c45 owned by network:router_interface {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:32.789039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.790903 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.2068648 Sep 16 16:25:32.793751 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41408) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:32.799936 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'security_group_rule': {'security_group_id': 'aedacc1b-4ab0-4ddd-9665-82d52bb9881e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:32.805062 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c680e41d-f080-47b3-a507-0425bf71d576 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aedacc1b-4ab0-4ddd-9665-82d52bb9881e,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:32.876491 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.905649 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab1f05b-abb8-42a4-b6d8-b19089bb6963 req-6a2282f4-2903-4955-b370-21903a115da9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:32.911671 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4ab1f05b-abb8-42a4-b6d8-b19089bb6963 req-6a2282f4-2903-4955-b370-21903a115da9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0668807 Sep 16 16:25:32.963629 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4ab1f05b-abb8-42a4-b6d8-b19089bb6963 req-ad729371-2c8d-47b9-96c3-99f9c7d13d03 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439467 Sep 16 16:25:32.992334 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:32.996469 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.023773 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=86670daa-85b0-4d24-96ed-653ed95e3d82,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:33.049354 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.053351 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-9e0f2681-1bc0-4bfb-af20-45ac76ca308a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2556720 Sep 16 16:25:33.053854 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41412) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:33.060215 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'security_group_rule': {'security_group_id': 'aedacc1b-4ab0-4ddd-9665-82d52bb9881e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:33.072154 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.092319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.101754 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Pushing event deleted for resources: {'Port': ['ID=f410a660-bea0-4ae7-868b-9db8e0cc0c45,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:33.175696 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.181216 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.214945 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f00c33a7-caef-42fd-8615-4640cf3b1b49,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:33.222145 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.223717 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0b97f141-b450-4d58-8a42-d4347201db31 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1679142 Sep 16 16:25:33.227066 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41414) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:33.232225 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:33.263397 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.340340 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.386795 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.541727 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Allocated IP 172.27.3.35 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/c494654a-62de-4ee4-b8ec-7c0bfbfb7442) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:33.607042 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Router c5d486d8-21f8-44c3-970d-2255111128dd has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:25:33.667288 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.714000 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.745607 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:25:33.752378 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-f3c362d9-bab6-47cb-8307-994008eba15b admin admin] 10.222.0.59 "PUT /v2.0/routers/c5d486d8-21f8-44c3-970d-2255111128dd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0172837 Sep 16 16:25:33.756729 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41460) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:33.757175 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] Sync routers for ids ['c5d486d8-21f8-44c3-970d-2255111128dd'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:25:33.763009 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:33.771078 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] Routers {'c5d486d8-21f8-44c3-970d-2255111128dd'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:33.771730 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['c5d486d8-21f8-44c3-970d-2255111128dd'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:33.773599 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:33.812203 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:33.817858 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'Port': ['ID=c494654a-62de-4ee4-b8ec-7c0bfbfb7442,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:33.907891 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 202f08bf-86f8-4762-b351-62fe1969aa8b up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:25:33.948852 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] Set router c5d486d8-21f8-44c3-970d-2255111128dd gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:33.965050 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks [] for router, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:33.997598 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 202f08bf-86f8-4762-b351-62fe1969aa8b triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:33.998062 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.073535 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.129355 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11b955e-b774-4329-ae33-815671de34b3 req-7aa9651d-1919-415e-b678-e2e3dc2c48c8 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:34.130956 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e11b955e-b774-4329-ae33-815671de34b3 req-7aa9651d-1919-415e-b678-e2e3dc2c48c8 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0890696 Sep 16 16:25:34.140622 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.166956 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 202f08bf-86f8-4762-b351-62fe1969aa8b, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=202f08bf-86f8-4762-b351-62fe1969aa8b,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:34.175512 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.178581 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.219809 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e11b955e-b774-4329-ae33-815671de34b3 req-faa500ab-0ec0-4d58-b4b7-ea626f466129 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821261 Sep 16 16:25:34.263669 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:25:33Z', 'revision_number': 5, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:34.268524 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=202f08bf-86f8-4762-b351-62fe1969aa8b,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:34.296538 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] Checking router: c5d486d8-21f8-44c3-970d-2255111128dd for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:25:34.306593 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] Routers {'c5d486d8-21f8-44c3-970d-2255111128dd'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:34.307278 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['c5d486d8-21f8-44c3-970d-2255111128dd'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:34.417262 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Sync routers for ids ['d52237e7-3781-41ad-9236-c7e649e67a9d'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:25:34.419815 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] Set router c5d486d8-21f8-44c3-970d-2255111128dd gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:34.433066 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Routers {'d52237e7-3781-41ad-9236-c7e649e67a9d'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:34.433833 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['d52237e7-3781-41ad-9236-c7e649e67a9d'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:34.489837 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.620975 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Set router d52237e7-3781-41ad-9236-c7e649e67a9d gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:34.630048 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Deleting port b4a2eb44-3630-47cf-ae00-b6a88646b14d {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:34.630351 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.641518 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:25:33Z', 'revision_number': 5, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:34.674644 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a94c7e3-f38b-45a6-aea1-bc09368ea3d1 None None] The sync data for ids ['c5d486d8-21f8-44c3-970d-2255111128dd'] in dv-cinder-805887-15-iscsi is: [{'id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'name': 'tempest-TestShelveInstance-894245059-router', 'tenant_id': '3320c65285f54af487d03b845f596772', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:25:33Z', 'revision_number': 5, 'project_id': '3320c65285f54af487d03b845f596772', 'gw_port': {'id': 'b4a2eb44-3630-47cf-ae00-b6a88646b14d', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:92:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5d486d8-21f8-44c3-970d-2255111128dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:34Z', 'updated_at': '2021-09-16T16:24:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:25:34.735494 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.747808 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.763137 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] For port b4a2eb44-3630-47cf-ae00-b6a88646b14d, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=b4a2eb44-3630-47cf-ae00-b6a88646b14d,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:34.763545 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.822765 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Calling delete_port for b4a2eb44-3630-47cf-ae00-b6a88646b14d owned by network:router_gateway {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:34.852159 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'Port': ['ID=c494654a-62de-4ee4-b8ec-7c0bfbfb7442,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:34.857818 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f457f757-3e3b-4e45-9016-a30d2863653c', 'name': '', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'mac_address': 'fa:16:3e:43:cf:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_interface', 'standard_attr_id': 493, 'fixed_ips': [{'subnet_id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:30Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 2, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'subnets': [{'id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:34.895096 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Checking router: d52237e7-3781-41ad-9236-c7e649e67a9d for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:25:34.895501 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Updating router d52237e7-3781-41ad-9236-c7e649e67a9d port f457f757-3e3b-4e45-9016-a30d2863653c binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:25:34.904083 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.930806 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:34.932142 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8798391b-56e1-4234-be5d-2ee7428f9e5a tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.7040730 Sep 16 16:25:34.936048 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.073121 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.110612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Pushing event deleted for resources: {'Port': ['ID=b4a2eb44-3630-47cf-ae00-b6a88646b14d,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:35.233524 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-cf7c6da5-6f57-4f0a-b65d-291ac80388a9 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--2013404473&fields=id&tenant_id=bafa01935144486cb747380ee210ccb9 HTTP/1.1" status: 200 len: 267 time: 0.0787423 Sep 16 16:25:35.234354 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.256931 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.263100 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.317564 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ccadb9d-db64-4893-9e61-5294146b8a13 None None] Pushing event updated for resources: {'Port': ['ID=f457f757-3e3b-4e45-9016-a30d2863653c,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:35.368137 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Attempting to bind port f457f757-3e3b-4e45-9016-a30d2863653c on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:35.368510 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Attempting to bind port f457f757-3e3b-4e45-9016-a30d2863653c by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:35.368855 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Attempting to bind port f457f757-3e3b-4e45-9016-a30d2863653c on network 2577e213-c4cb-4026-ab97-83e15eeef39e {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:35.374641 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:35.375042 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Checking segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:35.375440 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.375821 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Bound using segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:35.376289 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Bound port: f457f757-3e3b-4e45-9016-a30d2863653c, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:35.376668 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.390143 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.396497 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.413503 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e9be2a4-dcec-45c1-836f-f70941870147 req-58d5f46e-4de6-40c2-ba9a-c49ab949ae1b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:35.420985 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7e9be2a4-dcec-45c1-836f-f70941870147 req-58d5f46e-4de6-40c2-ba9a-c49ab949ae1b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0956111 Sep 16 16:25:35.449171 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] For port f457f757-3e3b-4e45-9016-a30d2863653c, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:35.452696 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] For port f457f757-3e3b-4e45-9016-a30d2863653c, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=f457f757-3e3b-4e45-9016-a30d2863653c,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:35.470663 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.475831 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7e9be2a4-dcec-45c1-836f-f70941870147 req-83d37adb-0078-41fd-846f-5a2fe2961fa6 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533285 Sep 16 16:25:35.512709 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.513244 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c5d486d8-21f8-44c3-970d-2255111128dd {{(pid=93951) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:25:35.523637 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.524912 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-6d7c9755-2b29-4685-b6fd-7d8f02e0b9d2 admin admin] 10.222.0.59 "DELETE /v2.0/routers/c5d486d8-21f8-44c3-970d-2255111128dd HTTP/1.1" status: 204 len: 168 time: 1.7640982 Sep 16 16:25:35.528054 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41508) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:35.539467 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Routers {'d52237e7-3781-41ad-9236-c7e649e67a9d'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:35.540115 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['d52237e7-3781-41ad-9236-c7e649e67a9d'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:35.543090 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-6edb1079-c184-4fa7-b592-209275ac0e64 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:35.544671 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-6edb1079-c184-4fa7-b592-209275ac0e64 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/networks?id=2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 200 len: 817 time: 0.2938490 Sep 16 16:25:35.563368 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-1f7e44c6-a487-4996-8f7b-468c70af17dd tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/quotas/bafa01935144486cb747380ee210ccb9 HTTP/1.1" status: 200 len: 375 time: 0.0121138 Sep 16 16:25:35.605217 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ccadb9d-db64-4893-9e61-5294146b8a13 None None] Pushing event updated for resources: {'Port': ['ID=f457f757-3e3b-4e45-9016-a30d2863653c,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:35.658641 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d0496d00-46c7-4b38-89ba-a1d48e7c33c8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=bafa01935144486cb747380ee210ccb9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0829287 Sep 16 16:25:35.800866 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-31ad482a-9c57-4eb4-bf98-e7011e16be0f service neutron] 10.222.0.59 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391656 Sep 16 16:25:35.864339 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Deleting subnet 4b5db019-2ec2-4635-90ac-83301ff8e797 {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:25:35.867402 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.896678 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-53b2c312-a1de-4ad0-a073-72ab940c9487 service neutron] 10.222.0.59 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949380 Sep 16 16:25:35.901508 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.905364 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-c764aebc-5093-483d-8785-1f7bc142c6ee None None] Provisioning complete for port f457f757-3e3b-4e45-9016-a30d2863653c triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:35.905735 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c764aebc-5093-483d-8785-1f7bc142c6ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:35.910602 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] Set router d52237e7-3781-41ad-9236-c7e649e67a9d gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:36.056121 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.139513 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4a13be32-b858-438c-91b5-d58e06bbcc00 req-1ded79e1-3e6f-4047-9826-810786cb6ce8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 210 time: 0.0374489 Sep 16 16:25:36.192897 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.202744 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c764aebc-5093-483d-8785-1f7bc142c6ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.221030 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.226376 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41522) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:36.227469 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] 10.222.0.59 "DELETE /v2.0/subnets/4b5db019-2ec2-4635-90ac-83301ff8e797 HTTP/1.1" status: 204 len: 168 time: 0.6980801 Sep 16 16:25:36.256972 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a933575c-7542-4489-a0ba-2b57853224db admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b5db019-2ec2-4635-90ac-83301ff8e797,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:36.268620 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4ebef61-0266-4156-b45b-e60d4c688a22 None None] Network e657e2d9-d56a-46a2-987f-ea59605a973c requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:25:36.344557 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 202f08bf-86f8-4762-b351-62fe1969aa8b up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:25:36.357698 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.418883 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Deleting port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:36.419528 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.456308 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-c764aebc-5093-483d-8785-1f7bc142c6ee None None] For port f457f757-3e3b-4e45-9016-a30d2863653c, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=f457f757-3e3b-4e45-9016-a30d2863653c,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:36.480273 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c764aebc-5093-483d-8785-1f7bc142c6ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.576711 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] For port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,segment=NetworkSegment(7bdee358-0ffe-449a-8264-a3184229e5b4),segment_id=7bdee358-0ffe-449a-8264-a3184229e5b4)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:36.577104 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.606771 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Calling delete_port for c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 owned by network:dhcp {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:36.638465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c764aebc-5093-483d-8785-1f7bc142c6ee None None] Pushing event updated for resources: {'Port': ['ID=f457f757-3e3b-4e45-9016-a30d2863653c,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:36.645080 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 202f08bf-86f8-4762-b351-62fe1969aa8b triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:36.645498 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.704893 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-4e3ba7c0-71db-4e86-904e-46bbcaa85a2c None None] Provisioning complete for port f457f757-3e3b-4e45-9016-a30d2863653c triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:36.705264 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4e3ba7c0-71db-4e86-904e-46bbcaa85a2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.712812 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f457f757-3e3b-4e45-9016-a30d2863653c', 'name': '', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'mac_address': 'fa:16:3e:43:cf:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_interface', 'standard_attr_id': 493, 'fixed_ips': [{'subnet_id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:30Z', 'updated_at': '2021-09-16T16:25:35Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'subnets': [{'id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:36.738275 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] DHCP port deletion for e657e2d9-d56a-46a2-987f-ea59605a973c request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:25:36.744068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13621b86-83e9-40be-aefc-86e2cf0676f2 req-32942880-1ad9-490d-97a8-f75ae147b39a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:36.751367 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-13621b86-83e9-40be-aefc-86e2cf0676f2 req-32942880-1ad9-490d-97a8-f75ae147b39a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1157453 Sep 16 16:25:36.774620 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-352c9aeb-0c00-4a1f-8d2d-0615e72fca4f None None] The sync data for ids ['d52237e7-3781-41ad-9236-c7e649e67a9d'] in dv-cinder-805887-15-iscsi is: [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:30Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': 'f457f757-3e3b-4e45-9016-a30d2863653c', 'name': '', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'mac_address': 'fa:16:3e:43:cf:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_interface', 'standard_attr_id': 493, 'fixed_ips': [{'subnet_id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:30Z', 'updated_at': '2021-09-16T16:25:35Z', 'revision_number': 4, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'subnets': [{'id': '12487de4-e994-4284-8ca2-3e5c64dab8fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:25:36.816003 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-13621b86-83e9-40be-aefc-86e2cf0676f2 req-a1f3e414-9f57-4da4-b246-8f73e2669b42 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633497 Sep 16 16:25:36.831036 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.876162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] No DVR routers for this DVR port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 on host dv-cinder-805887-15-iscsi {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:36.878297 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f457f757-3e3b-4e45-9016-a30d2863653c up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:25:36.880150 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:36.957239 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Deleting port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 {{(pid=93952) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:36.957862 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:36.977053 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.006513 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e657e2d9-d56a-46a2-987f-ea59605a973c']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:37.016364 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7bdee358-0ffe-449a-8264-a3184229e5b4') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:37.016899 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7bdee358-0ffe-449a-8264-a3184229e5b4') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:37.032892 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.035462 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port f457f757-3e3b-4e45-9016-a30d2863653c triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:37.035838 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.049182 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.055290 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Releasing vlan 718 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:25:37.055887 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:25:37.057502 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:25:37.060360 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] For port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8, host dv-cinder-805887-15-iscsi, got binding levels [] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:37.060591 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.078987 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Calling delete_port for c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 owned by network:dhcp {{(pid=93952) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:37.085320 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.ipam_backend_mixin [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 was not found and therefore no delete operation was performed {{(pid=93952) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Sep 16 16:25:37.088424 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147'] for port, after_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.121740 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] Pushing event deleted for resources: {'Port': ['ID=c4e418d2-30cd-4d01-a800-ebfcb06cd4b8,revision_number=None']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:37.130966 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da1bccb7-fbb5-41be-9bdc-9b07c475686f None None] No DVR routers for this DVR port c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 on host dv-cinder-805887-15-iscsi {{(pid=93952) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:37.205932 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f410a660-bea0-4ae7-868b-9db8e0cc0c45 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:37.229090 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: f410a660-bea0-4ae7-868b-9db8e0cc0c45 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:37.229805 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f410a660-bea0-4ae7-868b-9db8e0cc0c45 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:37.239475 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.275730 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.275730 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] 10.222.0.59 "DELETE /v2.0/networks/e657e2d9-d56a-46a2-987f-ea59605a973c HTTP/1.1" status: 204 len: 168 time: 1.0423605 Sep 16 16:25:37.276011 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41544) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:37.283531 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b0cf7a-30d2-4819-a1f6-bbd65e2535e8 admin admin] Pushing event deleted for resources: {'Network': ['ID=e657e2d9-d56a-46a2-987f-ea59605a973c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:37.306680 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-c3fb8dd3-5f9b-46cc-8bb0-cc68c2870983 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:37.308436 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-c3fb8dd3-5f9b-46cc-8bb0-cc68c2870983 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "GET /v2.0/networks?id=2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 200 len: 817 time: 0.1740472 Sep 16 16:25:37.361205 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-7505eff2-032f-4554-ba2d-b9f647d6b807 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bafa01935144486cb747380ee210ccb9 HTTP/1.1" status: 200 len: 380 time: 0.0387707 Sep 16 16:25:37.375846 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'port': {'device_id': '51be73cd-cd63-45cc-9137-019f9de24a36', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'admin_state_up': True, 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'security_groups': ['aedacc1b-4ab0-4ddd-9665-82d52bb9881e']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:37.384431 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-03d4ce03-b49d-4129-a4dd-36f816254b96 req-96e13212-b0dc-4c46-990b-6414193851e2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 210 time: 0.1123061 Sep 16 16:25:37.512914 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Made reservation on behalf of bafa01935144486cb747380ee210ccb9 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:25:37.517151 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.655442 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Allocated IP 172.20.0.8 (2577e213-c4cb-4026-ab97-83e15eeef39e/12487de4-e994-4284-8ca2-3e5c64dab8fe/6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:37.720679 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.791708 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f457f757-3e3b-4e45-9016-a30d2863653c up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:25:37.841391 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.877513 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port f457f757-3e3b-4e45-9016-a30d2863653c triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:37.877875 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.886123 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:37.937901 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Network 2577e213-c4cb-4026-ab97-83e15eeef39e is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:37.950012 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:37.967555 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:38.032546 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'Port': ['ID=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:38.074061 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Deleting port e2f6098f-dbf8-43d1-8c87-d108a4fb3884 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:38.076959 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:38.077625 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.080036 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.093588 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device b4a2eb44-3630-47cf-ae00-b6a88646b14d no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:38.126119 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c033e71-c744-4f4c-9b27-0211cdd8d458 req-cc435727-7956-4db1-a58e-ddbd975a5b69 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:38.133649 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3c033e71-c744-4f4c-9b27-0211cdd8d458 req-cc435727-7956-4db1-a58e-ddbd975a5b69 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.2024107 Sep 16 16:25:38.165759 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-58dd1784-f4b3-4506-a720-c71867f9ee82 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7945299 Sep 16 16:25:38.169124 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: b4a2eb44-3630-47cf-ae00-b6a88646b14d {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:38.169789 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device b4a2eb44-3630-47cf-ae00-b6a88646b14d not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:38.170327 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:38.194774 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3c033e71-c744-4f4c-9b27-0211cdd8d458 req-0e19b305-645c-4b00-b9a5-1e0ac78a696d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458624 Sep 16 16:25:38.200943 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Request body: {'port': {'device_id': '51be73cd-cd63-45cc-9137-019f9de24a36', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:38.212433 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] For port e2f6098f-dbf8-43d1-8c87-d108a4fb3884, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:38.212825 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.231078 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Calling delete_port for e2f6098f-dbf8-43d1-8c87-d108a4fb3884 owned by network:router_interface {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:38.235258 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:38.238913 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device c4e418d2-30cd-4d01-a800-ebfcb06cd4b8 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:38.293700 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.296329 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d98a29ee-5e31-4536-8912-14c0cb51fdf3 None None] Provisioning complete for port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:38.296708 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d98a29ee-5e31-4536-8912-14c0cb51fdf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.336536 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d98a29ee-5e31-4536-8912-14c0cb51fdf3 None None] Port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:25:38.451387 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.480256 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Pushing event deleted for resources: {'Port': ['ID=e2f6098f-dbf8-43d1-8c87-d108a4fb3884,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:38.579470 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e663922c-f15b-4fc1-9e9f-fa407f491831 req-773c3924-b8ab-454a-b088-cfa29adf89c5 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:38.581036 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e663922c-f15b-4fc1-9e9f-fa407f491831 req-773c3924-b8ab-454a-b088-cfa29adf89c5 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 931 time: 0.1040337 Sep 16 16:25:38.588591 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:25:38.597214 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.616313 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Transition to ACTIVE for port object 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:25:38.622231 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.674566 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e663922c-f15b-4fc1-9e9f-fa407f491831 req-1282508c-b1dc-4281-a0e6-be29d40e9454 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups?id=aedacc1b-4ab0-4ddd-9665-82d52bb9881e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0835807 Sep 16 16:25:38.715057 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Pushing event updated for resources: {'Port': ['ID=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:38.743342 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.749590 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Attempting to bind port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:38.749964 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Attempting to bind port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:38.750298 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Attempting to bind port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 on network 2577e213-c4cb-4026-ab97-83e15eeef39e {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:38.757268 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 on network 2577e213-c4cb-4026-ab97-83e15eeef39e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:25:38.757593 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Attempting to bind port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 on network 2577e213-c4cb-4026-ab97-83e15eeef39e {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:38.762765 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:38.763100 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Checking segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:38.763522 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Bound using segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:38.764002 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Bound port: 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:38.764363 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.836026 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] For port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:38.839488 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] For port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:38.844857 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.877423 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:38.877916 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:38.879332 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] 10.222.0.66 "PUT /v2.0/ports/6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 HTTP/1.1" status: 200 len: 1093 time: 0.6841662 Sep 16 16:25:38.879784 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51be73cd-cd63-45cc-9137-019f9de24a36', 'tag': '6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:38.882547 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe" -d '{"events": [{"name": "network-changed", "server_uuid": "51be73cd-cd63-45cc-9137-019f9de24a36", "tag": "6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:38.922269 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d37f7ea0-afdc-4e46-a5b0-97c1b961080c service neutron] Pushing event updated for resources: {'Port': ['ID=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:38.933177 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69313b22-afad-4323-ac6b-e34f158ac7e9 x-openstack-request-id: req-69313b22-afad-4323-ac6b-e34f158ac7e9 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:38.933745 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "51be73cd-cd63-45cc-9137-019f9de24a36", "tag": "6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:38.934271 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-69313b22-afad-4323-ac6b-e34f158ac7e9 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:38.934866 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51be73cd-cd63-45cc-9137-019f9de24a36', 'tag': '6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6', 'status': 'completed', 'code': 200} Sep 16 16:25:38.982147 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-10fdd81c-cfa2-4d2a-a669-50aab0e70641 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:38.983677 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-10fdd81c-cfa2-4d2a-a669-50aab0e70641 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=bafa01935144486cb747380ee210ccb9&device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 1096 time: 0.0451849 Sep 16 16:25:38.991489 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Router 0f4d2d64-e8e8-4901-b561-086787991683 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:25:39.030866 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-c3bbd42a-a840-4d5c-b947-46bc711079b3 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 HTTP/1.1" status: 200 len: 217 time: 0.0381291 Sep 16 16:25:39.082581 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-35512065-7b19-41b5-a53e-5a9fa540b4a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.084051 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-35512065-7b19-41b5-a53e-5a9fa540b4a6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=12487de4-e994-4284-8ca2-3e5c64dab8fe HTTP/1.1" status: 200 len: 856 time: 0.0448327 Sep 16 16:25:39.109799 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:25:39.114975 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-88f06e80-5945-4364-8588-080442719c5c admin admin] 10.222.0.59 "PUT /v2.0/routers/0f4d2d64-e8e8-4901-b561-086787991683/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8399196 Sep 16 16:25:39.117977 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41572) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:39.127278 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] Sync routers for ids ['0f4d2d64-e8e8-4901-b561-086787991683'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:25:39.133758 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-bc3fadc8-bc69-4e03-806f-e9b93b71e69c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.135286 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-bc3fadc8-bc69-4e03-806f-e9b93b71e69c service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=2577e213-c4cb-4026-ab97-83e15eeef39e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0438600 Sep 16 16:25:39.137614 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] Routers {'0f4d2d64-e8e8-4901-b561-086787991683'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:39.138235 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['0f4d2d64-e8e8-4901-b561-086787991683'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:39.266605 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-df317413-aa18-41d7-9267-bc10f5fca0c7 service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1220498 Sep 16 16:25:39.380205 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] Set router 0f4d2d64-e8e8-4901-b561-086787991683 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:39.405729 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-a9f34065-7999-4720-ba6a-0b1bcc2da16b service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1275685 Sep 16 16:25:39.479763 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26d643fd-6cf9-426f-a044-9bafc995821b req-305e17e9-0fef-4dd7-a139-5d3c16ac0761 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.481738 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-26d643fd-6cf9-426f-a044-9bafc995821b req-305e17e9-0fef-4dd7-a139-5d3c16ac0761 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1055245 Sep 16 16:25:39.519429 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks [] for router, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:39.559841 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-3984d40c-63f5-4f5e-81f1-6e6c378ebc56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.563361 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-3984d40c-63f5-4f5e-81f1-6e6c378ebc56 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=bafa01935144486cb747380ee210ccb9&device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 1096 time: 0.1010389 Sep 16 16:25:39.576119 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-26d643fd-6cf9-426f-a044-9bafc995821b req-1eba492c-f5bb-4918-8e74-af11d9f649de tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875068 Sep 16 16:25:39.690406 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:39.691636 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9'}], 'enable_snat': True}, 'gw_port_id': '27df033d-1cce-4324-9959-3c38ee56e896', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:25:38Z', 'revision_number': 5, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port': {'id': '27df033d-1cce-4324-9959-3c38ee56e896', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:9a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4d2d64-e8e8-4901-b561-086787991683', 'device_owner': 'network:router_gateway', 'standard_attr_id': 449, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:24:40Z', 'updated_at': '2021-09-16T16:24:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:39.696383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-5ffd1d2a-bfc6-462b-b53d-57f52e3ca547 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.697937 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-5ffd1d2a-bfc6-462b-b53d-57f52e3ca547 service neutron] 10.222.0.66 "GET /v2.0/networks?id=2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 200 len: 918 time: 0.1272519 Sep 16 16:25:39.743578 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] Checking router: 0f4d2d64-e8e8-4901-b561-086787991683 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:25:39.752432 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] Routers {'0f4d2d64-e8e8-4901-b561-086787991683'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:39.753350 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['0f4d2d64-e8e8-4901-b561-086787991683'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:39.800014 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-661357ec-6bb3-419e-b563-2b688db07234 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 HTTP/1.1" status: 200 len: 217 time: 0.0934913 Sep 16 16:25:39.850679 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-13c19c80-c082-4edd-a5d5-e5b617c0fead tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.852301 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-13c19c80-c082-4edd-a5d5-e5b617c0fead tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 943 time: 0.0831189 Sep 16 16:25:39.869255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-9ac370a9-3ec2-402c-bdae-850ecc115b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.869923 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] Set router 0f4d2d64-e8e8-4901-b561-086787991683 gateway port host: None {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:39.870698 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-9ac370a9-3ec2-402c-bdae-850ecc115b0d service neutron] 10.222.0.66 "GET /v2.0/subnets?id=12487de4-e994-4284-8ca2-3e5c64dab8fe HTTP/1.1" status: 200 len: 856 time: 0.0623376 Sep 16 16:25:39.871813 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Deleting port 27df033d-1cce-4324-9959-3c38ee56e896 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:39.872250 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:39.881522 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e62edd-afa0-43ed-b047-af5dff31aa6c req-c490226e-f170-4c26-8c4d-677c1bd1f79b tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.882879 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-28e62edd-afa0-43ed-b047-af5dff31aa6c req-c490226e-f170-4c26-8c4d-677c1bd1f79b tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 943 time: 0.0853479 Sep 16 16:25:39.934538 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:25:39Z', 'revision_number': 6, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:39.948325 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-28e62edd-afa0-43ed-b047-af5dff31aa6c req-7d623712-2132-40c7-b51d-dea445e24078 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups?id=aedacc1b-4ab0-4ddd-9665-82d52bb9881e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571287 Sep 16 16:25:39.953139 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-cef0d136-6b05-42c2-a760-52c1c366d67d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:39.954688 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-cef0d136-6b05-42c2-a760-52c1c366d67d service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=2577e213-c4cb-4026-ab97-83e15eeef39e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0708218 Sep 16 16:25:39.982570 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-199bade3-0cc3-4ed7-b292-970efa6b7558 None None] The sync data for ids ['0f4d2d64-e8e8-4901-b561-086787991683'] in dv-cinder-805887-15-iscsi is: [{'id': '0f4d2d64-e8e8-4901-b561-086787991683', 'name': 'tempest-TestShelveInstance-1788779694-router', 'tenant_id': '0f9054205aaa4371b1152f904e9babc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:24:39Z', 'updated_at': '2021-09-16T16:25:39Z', 'revision_number': 6, 'project_id': '0f9054205aaa4371b1152f904e9babc9', 'gw_port_host': None}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:25:40.027775 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] For port 27df033d-1cce-4324-9959-3c38ee56e896, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=27df033d-1cce-4324-9959-3c38ee56e896,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:40.028164 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.044641 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Calling delete_port for 27df033d-1cce-4324-9959-3c38ee56e896 owned by network:router_gateway {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:40.058348 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Deleting port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:40.058740 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.246430 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] For port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:40.246711 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.265604 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Calling delete_port for 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 owned by compute:nova {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:40.311220 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-712e1304-c64a-4516-8235-f20848fca748 service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3484814 Sep 16 16:25:40.379606 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.410264 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Pushing event deleted for resources: {'Port': ['ID=27df033d-1cce-4324-9959-3c38ee56e896,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:40.413700 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b0ce34f7-94c2-4439-b661-c2e4571e0ffe req-2878b230-21b8-43e3-819e-0730cb1b0105 service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938873 Sep 16 16:25:40.511087 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.514271 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.601744 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event deleted for resources: {'Port': ['ID=6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:40.647821 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.653457 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.671353 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] No DVR routers for this DVR port 6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 on host hv-cinder-80588 {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:40.685454 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.687370 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-9d627f9c-da1b-4889-b93e-668bd40c62f7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "DELETE /v2.0/ports/6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6 HTTP/1.1" status: 204 len: 173 time: 0.8245933 Sep 16 16:25:40.687825 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51be73cd-cd63-45cc-9137-019f9de24a36', 'name': 'network-vif-deleted', 'tag': '6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:40.690341 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da4b8b14-5c38-4b3f-b09c-6f82fa19fffb" -d '{"events": [{"server_uuid": "51be73cd-cd63-45cc-9137-019f9de24a36", "name": "network-vif-deleted", "tag": "6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:40.743809 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-62206d93-9d62-492a-954d-0972c67ef94f x-openstack-request-id: req-62206d93-9d62-492a-954d-0972c67ef94f {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:40.744102 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51be73cd-cd63-45cc-9137-019f9de24a36", "name": "network-vif-deleted", "tag": "6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6", "status": "failed", "code": 422}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:40.744374 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-62206d93-9d62-492a-954d-0972c67ef94f {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:40.744786 dv-cinder-805887-15-iscsi neutron-server[93950]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '51be73cd-cd63-45cc-9137-019f9de24a36', 'name': 'network-vif-deleted', 'tag': '6ff99b0d-81a9-4dc2-a7f1-ab595a3206e6', 'status': 'failed', 'code': 422} returned with failed status Sep 16 16:25:40.768032 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.768032 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f4d2d64-e8e8-4901-b561-086787991683 {{(pid=93950) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:25:40.775573 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.779311 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-68cdde05-d59b-472b-8eb4-a92b87c82afc admin admin] 10.222.0.59 "DELETE /v2.0/routers/0f4d2d64-e8e8-4901-b561-086787991683 HTTP/1.1" status: 204 len: 168 time: 1.6578228 Sep 16 16:25:40.781118 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41598) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:40.815278 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e919675-660c-44af-978f-4d1aecba99a9 req-e4e30766-831e-48fa-93ad-049a7790a25e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:40.824143 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6e919675-660c-44af-978f-4d1aecba99a9 req-e4e30766-831e-48fa-93ad-049a7790a25e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1557376 Sep 16 16:25:40.854588 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Deleting subnet 4b39c2db-aa23-4957-a338-6296fbf4b9ef {{(pid=93951) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:25:40.858656 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:40.884371 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6e919675-660c-44af-978f-4d1aecba99a9 req-621a83e2-4677-4254-bcdf-996d3a00848d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544276 Sep 16 16:25:40.897697 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-58472601'] for subnet, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.025398 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.080798 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2b5b939c-e8a6-40f5-9056-7535dde34fa7 req-d3d28a38-be3b-4b36-be87-9e092ea71a28 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 210 time: 0.0525284 Sep 16 16:25:41.125335 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-58361729', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58434304'] for subnet, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.149686 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41606) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:41.166447 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b39c2db-aa23-4957-a338-6296fbf4b9ef,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:41.168506 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.170365 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-6e3b6126-e26a-43a9-959e-039fda3d350b admin admin] 10.222.0.59 "DELETE /v2.0/subnets/4b39c2db-aa23-4957-a338-6296fbf4b9ef HTTP/1.1" status: 204 len: 168 time: 0.3876677 Sep 16 16:25:41.173715 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41608) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:41.175509 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e105073-2f21-44bc-b715-bcb1cd8b936b None None] Network a7e04255-5ffc-4690-9fd6-cd627067ded5 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:25:41.186937 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-21f2541c-7eea-46e3-a5b8-334b2c62dd88 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 210 time: 0.0353837 Sep 16 16:25:41.254110 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.307982 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Deleting port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:41.308236 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.367504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] DHCP port deletion for a7e04255-5ffc-4690-9fd6-cd627067ded5 request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:25:41.376435 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] For port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:41.376815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.388732 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Calling delete_port for d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a owned by network:dhcp {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:41.415431 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] Deleting port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a {{(pid=93952) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:41.415725 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.466098 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.484244 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] For port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,segment=NetworkSegment(f2607963-ecb2-42f2-9eb9-7c4ad174c81c),segment_id=f2607963-ecb2-42f2-9eb9-7c4ad174c81c)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:41.484632 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.496781 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:41.498619 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] No DVR routers for this DVR port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a on host dv-cinder-805887-15-iscsi {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:41.498751 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] Calling delete_port for d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a owned by network:dhcp {{(pid=93952) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:41.575778 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.596955 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a7e04255-5ffc-4690-9fd6-cd627067ded5']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:41.607892 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:41.608049 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f2607963-ecb2-42f2-9eb9-7c4ad174c81c') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:41.614094 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147'] for port, after_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.629104 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.642655 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.645454 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] No DVR routers for this DVR port d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a on host dv-cinder-805887-15-iscsi {{(pid=93952) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:41.649017 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Releasing vlan 732 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:25:41.649412 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.649525 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc71209-41bf-4a97-870a-eb670b8166b8 None None] Pushing event deleted for resources: {'Port': ['ID=d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a,revision_number=None']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:25:41.654703 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:25:41.705071 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.715556 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:41.717701 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] 10.222.0.59 "DELETE /v2.0/networks/a7e04255-5ffc-4690-9fd6-cd627067ded5 HTTP/1.1" status: 204 len: 168 time: 0.5426214 Sep 16 16:25:41.729866 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a866ae95-0da6-428b-9432-c64387f5d9b0 admin admin] Pushing event deleted for resources: {'Network': ['ID=a7e04255-5ffc-4690-9fd6-cd627067ded5,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:41.761244 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device e2f6098f-dbf8-43d1-8c87-d108a4fb3884 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:41.788083 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: e2f6098f-dbf8-43d1-8c87-d108a4fb3884 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:41.788426 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device e2f6098f-dbf8-43d1-8c87-d108a4fb3884 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:41.788848 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:41.808456 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:41.808798 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d9fc404e-c8a5-4cc4-9ad5-6effeb9b806a not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:41.809203 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 27df033d-1cce-4324-9959-3c38ee56e896 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:41.829684 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 27df033d-1cce-4324-9959-3c38ee56e896 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:41.830058 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 27df033d-1cce-4324-9959-3c38ee56e896 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:41.887922 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41614) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:41.936942 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-92198911-dc32-4048-a62e-96f6530d08ae admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=3320c65285f54af487d03b845f596772&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0478244 Sep 16 16:25:41.939569 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41618) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:42.019907 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-87579659-c422-47d1-b669-235f7dd3e3f0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.030601 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb64c25-72a1-438b-b5ed-b0af9301e4c2 req-64d13ebd-c4b3-4dee-a11f-38c46c202ab1 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:42.032237 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4eb64c25-72a1-438b-b5ed-b0af9301e4c2 req-64d13ebd-c4b3-4dee-a11f-38c46c202ab1 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0725758 Sep 16 16:25:42.065883 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-87579659-c422-47d1-b669-235f7dd3e3f0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.102336 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4eb64c25-72a1-438b-b5ed-b0af9301e4c2 req-e624a5f5-80e2-4cca-8f59-3a2b1e278b57 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621254 Sep 16 16:25:42.127114 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-87579659-c422-47d1-b669-235f7dd3e3f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.130311 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-87579659-c422-47d1-b669-235f7dd3e3f0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.131787 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-87579659-c422-47d1-b669-235f7dd3e3f0 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/6148800b-c70a-4fb2-8809-175c22b0cf1e HTTP/1.1" status: 204 len: 168 time: 0.1912904 Sep 16 16:25:42.142218 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87579659-c422-47d1-b669-235f7dd3e3f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6148800b-c70a-4fb2-8809-175c22b0cf1e,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:42.225199 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bb9a7ec0-307a-4d2b-8061-196840edae2f req-638f8b08-682a-4a94-a35b-fba72f98b1ec tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 210 time: 0.0335326 Sep 16 16:25:42.394364 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4611d50e-d648-492c-8966-d46bf10a7c46 req-62d96028-7149-4f37-961e-5adf60108aca tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=51be73cd-cd63-45cc-9137-019f9de24a36 HTTP/1.1" status: 200 len: 210 time: 0.0305061 Sep 16 16:25:42.487292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41638) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:42.529733 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-30878e70-ed5b-40bd-a497-822c6d7cf48f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0f9054205aaa4371b1152f904e9babc9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0412831 Sep 16 16:25:42.532330 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41640) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:42.582332 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cfb38fb2-5e20-4d7f-b7de-66a727653134 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.606398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cfb38fb2-5e20-4d7f-b7de-66a727653134 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.654803 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cfb38fb2-5e20-4d7f-b7de-66a727653134 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.659718 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cfb38fb2-5e20-4d7f-b7de-66a727653134 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.663857 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-cfb38fb2-5e20-4d7f-b7de-66a727653134 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/172a0620-3a65-4a8c-a5a3-ebdc52521444 HTTP/1.1" status: 204 len: 168 time: 0.1277416 Sep 16 16:25:42.671140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb38fb2-5e20-4d7f-b7de-66a727653134 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=172a0620-3a65-4a8c-a5a3-ebdc52521444,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:42.883687 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41656) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:42.950442 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aed4ec58-70ad-4142-b88b-032917f55ac2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:42.979386 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aed4ec58-70ad-4142-b88b-032917f55ac2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.027338 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aed4ec58-70ad-4142-b88b-032917f55ac2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.030319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-aed4ec58-70ad-4142-b88b-032917f55ac2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.031637 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-aed4ec58-70ad-4142-b88b-032917f55ac2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "DELETE /v2.0/security-groups/aedacc1b-4ab0-4ddd-9665-82d52bb9881e HTTP/1.1" status: 204 len: 168 time: 0.1469691 Sep 16 16:25:43.034468 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41658) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:43.041068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed4ec58-70ad-4142-b88b-032917f55ac2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aedacc1b-4ab0-4ddd-9665-82d52bb9881e,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:43.047975 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.api.v2.resource [None req-bae42d01-89b0-4aa9-89b7-38ad92e5c4fe tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] show failed (client error): The resource could not be found. Sep 16 16:25:43.049735 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-bae42d01-89b0-4aa9-89b7-38ad92e5c4fe tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups/aedacc1b-4ab0-4ddd-9665-82d52bb9881e HTTP/1.1" status: 404 len: 347 time: 0.0138412 Sep 16 16:25:43.052149 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41660) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:43.220090 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Deleting port c494654a-62de-4ee4-b8ec-7c0bfbfb7442 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:43.220428 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.233526 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3765636-cf07-4e54-a557-ddb22c35d155 req-f32fe674-02f1-45d7-a238-9267e1655815 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:43.235010 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c3765636-cf07-4e54-a557-ddb22c35d155 req-f32fe674-02f1-45d7-a238-9267e1655815 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0634105 Sep 16 16:25:43.273811 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c3765636-cf07-4e54-a557-ddb22c35d155 req-56ae2164-f126-43bf-a76d-0f4cb5a979ef tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319290 Sep 16 16:25:43.311919 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.312403 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.325548 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Calling delete_port for c494654a-62de-4ee4-b8ec-7c0bfbfb7442 owned by network:floatingip {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:43.369383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41670) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:43.469871 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.484699 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fb833455-6e66-433d-a631-27e1e660ede2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.496380 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event deleted for resources: {'Port': ['ID=c494654a-62de-4ee4-b8ec-7c0bfbfb7442,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:43.561132 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.563869 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.565300 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-280804b0-8264-46cf-8b7c-71e89e5735c2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "DELETE /v2.0/floatingips/e234a9ef-2e09-4dd9-943c-3546afb66ee4 HTTP/1.1" status: 204 len: 168 time: 0.5122559 Sep 16 16:25:43.588213 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fb833455-6e66-433d-a631-27e1e660ede2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.592294 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fb833455-6e66-433d-a631-27e1e660ede2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.630227 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb833455-6e66-433d-a631-27e1e660ede2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fea420a-d565-46c2-bbaa-d69326011f6f,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:43.636589 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-fb833455-6e66-433d-a631-27e1e660ede2 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=67aa3391114347498e2793d47ab6e7e4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2654932 Sep 16 16:25:43.638075 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41676) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:43.687545 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9e1a64af-0825-4a01-90c3-e9cc0c2c7eb4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.722019 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9e1a64af-0825-4a01-90c3-e9cc0c2c7eb4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.779920 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41680) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:43.787193 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1648276187', 'description': 'tempest-description--1852231806'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:43.793497 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9e1a64af-0825-4a01-90c3-e9cc0c2c7eb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.796066 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9e1a64af-0825-4a01-90c3-e9cc0c2c7eb4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.799707 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-9e1a64af-0825-4a01-90c3-e9cc0c2c7eb4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7fea420a-d565-46c2-bbaa-d69326011f6f HTTP/1.1" status: 204 len: 168 time: 0.1582911 Sep 16 16:25:43.813393 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1a64af-0825-4a01-90c3-e9cc0c2c7eb4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fea420a-d565-46c2-bbaa-d69326011f6f,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:43.826742 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.920259 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.924438 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.951648 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:43.952864 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.1715441 Sep 16 16:25:43.956515 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41688) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:43.956996 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-465eb8c1-b246-4c03-b469-8c3927e7a4d8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0940c86c-ca66-4447-ad40-4cc953555435,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:43.962719 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'security_group_rule': {'security_group_id': '0940c86c-ca66-4447-ad40-4cc953555435', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:43.991144 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.046421 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.051580 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.070522 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41b64531-e515-46d7-b63f-7c181c4c61f2,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:44.077028 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.078220 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-19a87ca8-c179-464f-ace2-42489c8675e7 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1202450 Sep 16 16:25:44.081019 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41690) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:44.086351 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'security_group_rule': {'security_group_id': '0940c86c-ca66-4447-ad40-4cc953555435', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:44.109195 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41692) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:44.114487 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.122082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c3c3958f-a607-4dbc-9564-25f55eb580d8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.179626 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.183591 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.201367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7e3974b6-d93a-4c56-98d9-73850b1fef88,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:44.223107 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c3c3958f-a607-4dbc-9564-25f55eb580d8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.227085 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c3c3958f-a607-4dbc-9564-25f55eb580d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.230815 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.232174 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-f7356854-b139-4730-a278-9a53dc680404 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1500704 Sep 16 16:25:44.235192 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41694) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:44.239539 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:44.263909 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.267033 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c3c3958f-a607-4dbc-9564-25f55eb580d8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=d416d41711c448338450c72fcd4ec020&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1567132 Sep 16 16:25:44.267904 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c3958f-a607-4dbc-9564-25f55eb580d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d3b5092-05d2-4f71-ac3d-339c191d2347,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:44.270149 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41696) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:44.326568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-58b84351-2c69-4050-bae3-284f514450d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.357476 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-58b84351-2c69-4050-bae3-284f514450d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.372447 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.417558 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6b06f9-d9c2-498f-a833-38685e4884a6 req-83f48a91-83b8-41c7-aeb8-1e92ef693fc0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:44.419052 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cb6b06f9-d9c2-498f-a833-38685e4884a6 req-83f48a91-83b8-41c7-aeb8-1e92ef693fc0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0747249 Sep 16 16:25:44.448580 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-58b84351-2c69-4050-bae3-284f514450d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.451055 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-58b84351-2c69-4050-bae3-284f514450d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.452198 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-58b84351-2c69-4050-bae3-284f514450d3 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/6d3b5092-05d2-4f71-ac3d-339c191d2347 HTTP/1.1" status: 204 len: 168 time: 0.1811609 Sep 16 16:25:44.470841 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b84351-2c69-4050-bae3-284f514450d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d3b5092-05d2-4f71-ac3d-339c191d2347,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:44.476778 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cb6b06f9-d9c2-498f-a833-38685e4884a6 req-7c27e79c-ecac-4d55-a0a2-2f6251cafc49 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508418 Sep 16 16:25:44.499417 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Allocated IP 172.27.3.215 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/504ab6db-326b-49ef-8840-d797f263aca4) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:44.610997 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.646034 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.682576 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:44.685497 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:44.687950 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:44.724022 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'Port': ['ID=504ab6db-326b-49ef-8840-d797f263aca4,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:44.817831 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:44.855860 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:45.234073 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:45.238337 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:45.313947 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'Port': ['ID=504ab6db-326b-49ef-8840-d797f263aca4,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:45.323151 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:45.336219 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:45.337408 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-094c51fc-e870-44ed-b266-aefc061c3f71 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1012702 Sep 16 16:25:45.578350 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-a957ab2b-84e8-477a-96a2-e83b0c353171 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--1648276187&fields=id&tenant_id=bafa01935144486cb747380ee210ccb9 HTTP/1.1" status: 200 len: 267 time: 0.0803814 Sep 16 16:25:45.619879 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda9a779-afbd-4e17-bd29-fa5540b06972 req-a0ca4611-6b14-4fbb-88f8-827e8c9826dd tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:45.621623 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dda9a779-afbd-4e17-bd29-fa5540b06972 req-a0ca4611-6b14-4fbb-88f8-827e8c9826dd tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0784352 Sep 16 16:25:45.662825 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dda9a779-afbd-4e17-bd29-fa5540b06972 req-d401bbcd-a099-4108-9f4a-58bedf559226 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345054 Sep 16 16:25:45.670580 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:45.705679 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-2685cf56-de2c-4648-b480-917f73f3e5f0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:45.707134 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-2685cf56-de2c-4648-b480-917f73f3e5f0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/networks?id=2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 200 len: 817 time: 0.1197848 Sep 16 16:25:45.721559 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-39a0aec5-4f16-4884-b34a-92e27e5335c5 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/quotas/bafa01935144486cb747380ee210ccb9 HTTP/1.1" status: 200 len: 375 time: 0.0087564 Sep 16 16:25:45.772136 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-1ca1203d-a9da-424b-8a83-d5ce05b66473 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=bafa01935144486cb747380ee210ccb9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0449214 Sep 16 16:25:45.870986 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-b71a32c8-9094-4981-beec-7a568bff56da service neutron] 10.222.0.59 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877380 Sep 16 16:25:45.963728 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-0f3ab08e-f3bc-4612-a418-d035ba20d149 service neutron] 10.222.0.59 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866349 Sep 16 16:25:46.124320 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2b25613-75d8-49f9-a686-732a4b62d2b1 req-a5f09fd7-cf29-4561-b8d8-1841698297c6 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 210 time: 0.0259740 Sep 16 16:25:46.793165 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a2774f-7e15-4ed6-bc49-5c788f7bfbdb req-82783ac8-801a-450a-a7af-1d62e045980c tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:46.795295 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-53a2774f-7e15-4ed6-bc49-5c788f7bfbdb req-82783ac8-801a-450a-a7af-1d62e045980c tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0558546 Sep 16 16:25:46.874322 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-53a2774f-7e15-4ed6-bc49-5c788f7bfbdb req-81967ba6-bcb2-41ed-a12f-e717553a617d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717247 Sep 16 16:25:46.942889 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-1c2cd9ab-19f2-4c6c-b7bc-d0f44c81ba0e tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:46.945488 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-1c2cd9ab-19f2-4c6c-b7bc-d0f44c81ba0e tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "GET /v2.0/networks?id=2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 200 len: 817 time: 0.1231740 Sep 16 16:25:47.017698 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-655fc30b-2675-4281-abfe-2fdb448d4bb2 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bafa01935144486cb747380ee210ccb9 HTTP/1.1" status: 200 len: 380 time: 0.0547750 Sep 16 16:25:47.028325 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Request body: {'port': {'device_id': '50cba947-cb5f-4cc8-85d3-642dff3b9b11', 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e', 'admin_state_up': True, 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'security_groups': ['0940c86c-ca66-4447-ad40-4cc953555435']}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:47.140140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Made reservation on behalf of bafa01935144486cb747380ee210ccb9 for: {'port': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:25:47.143618 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.229038 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-98beb6fb-ea39-4580-9acf-0af5163e34e1 req-c0d477d4-7c4d-419e-b8f7-52e4b06bc11b tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 210 time: 0.0277314 Sep 16 16:25:47.282091 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Allocated IP 172.20.0.12 (2577e213-c4cb-4026-ab97-83e15eeef39e/12487de4-e994-4284-8ca2-3e5c64dab8fe/30aca23c-efa6-4de5-8706-37d5adb501fd) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:25:47.416888 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.456845 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.502105 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Network 2577e213-c4cb-4026-ab97-83e15eeef39e is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:25:47.505137 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:25:47.508781 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:25:47.536319 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event updated for resources: {'Port': ['ID=30aca23c-efa6-4de5-8706-37d5adb501fd,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:47.565026 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:47.565643 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.579904 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-b9207adf-57db-470b-8667-ec0e71e730b0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5554614 Sep 16 16:25:47.594369 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Request body: {'port': {'device_id': '50cba947-cb5f-4cc8-85d3-642dff3b9b11', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:25:47.648586 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.769985 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-bf4493cd-5bdb-488d-ae67-84e1291bd932 None None] Provisioning complete for port 30aca23c-efa6-4de5-8706-37d5adb501fd triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:25:47.770542 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-bf4493cd-5bdb-488d-ae67-84e1291bd932 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.914133 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 30aca23c-efa6-4de5-8706-37d5adb501fd {{(pid=93950) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:25:47.921683 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:47.923098 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-bf4493cd-5bdb-488d-ae67-84e1291bd932 None None] Port 30aca23c-efa6-4de5-8706-37d5adb501fd cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:25:47.933748 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.provisioning_blocks [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Transition to ACTIVE for port object 30aca23c-efa6-4de5-8706-37d5adb501fd will not be triggered until provisioned by entity L2. {{(pid=93950) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:25:47.937599 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.025124 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Pushing event updated for resources: {'Port': ['ID=30aca23c-efa6-4de5-8706-37d5adb501fd,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:48.074331 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6109a10d-4858-4fec-b2a4-f6fab99af59f req-83c0f073-804b-4cbf-8b12-5e79097ee79b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.076037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6109a10d-4858-4fec-b2a4-f6fab99af59f req-83c0f073-804b-4cbf-8b12-5e79097ee79b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1283362 Sep 16 16:25:48.135590 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6109a10d-4858-4fec-b2a4-f6fab99af59f req-d5b5ec35-9118-4b86-934d-f6d1a7f1d033 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505133 Sep 16 16:25:48.141876 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Attempting to bind port 30aca23c-efa6-4de5-8706-37d5adb501fd on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:25:48.142214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Attempting to bind port 30aca23c-efa6-4de5-8706-37d5adb501fd by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:25:48.142547 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Attempting to bind port 30aca23c-efa6-4de5-8706-37d5adb501fd on network 2577e213-c4cb-4026-ab97-83e15eeef39e {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:48.147814 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Port 30aca23c-efa6-4de5-8706-37d5adb501fd on network 2577e213-c4cb-4026-ab97-83e15eeef39e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:25:48.148132 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Attempting to bind port 30aca23c-efa6-4de5-8706-37d5adb501fd on network 2577e213-c4cb-4026-ab97-83e15eeef39e {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:25:48.152896 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 25, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:25:48.153227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Checking segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:25:48.153600 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Bound using segment: {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'} {{(pid=93950) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:25:48.154025 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.managers [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Bound port: 30aca23c-efa6-4de5-8706-37d5adb501fd, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4c0fb585-da88-48c0-976a-40a4f44418a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 709, 'network_id': '2577e213-c4cb-4026-ab97-83e15eeef39e'}}] {{(pid=93950) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:25:48.154377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.216057 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] For port 30aca23c-efa6-4de5-8706-37d5adb501fd, host hv-cinder-80588, cleared binding levels {{(pid=93950) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:25:48.218979 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] For port 30aca23c-efa6-4de5-8706-37d5adb501fd, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=30aca23c-efa6-4de5-8706-37d5adb501fd,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93950) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:25:48.223494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.261533 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.262147 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.263565 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] 10.222.0.66 "PUT /v2.0/ports/30aca23c-efa6-4de5-8706-37d5adb501fd HTTP/1.1" status: 200 len: 1094 time: 0.6736071 Sep 16 16:25:48.264010 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '50cba947-cb5f-4cc8-85d3-642dff3b9b11', 'tag': '30aca23c-efa6-4de5-8706-37d5adb501fd'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:48.266244 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a598085a-0a12-41f5-8b44-c3870e9e1c1f" -d '{"events": [{"name": "network-changed", "server_uuid": "50cba947-cb5f-4cc8-85d3-642dff3b9b11", "tag": "30aca23c-efa6-4de5-8706-37d5adb501fd"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:48.292872 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d391fd6-fbe1-4c97-9c2f-30bbbd70e0a0 service neutron] Pushing event updated for resources: {'Port': ['ID=30aca23c-efa6-4de5-8706-37d5adb501fd,revision_number=3']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:48.353517 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26c059e9-6fa9-4f9a-b9e2-c86d9d8af9e7 x-openstack-request-id: req-26c059e9-6fa9-4f9a-b9e2-c86d9d8af9e7 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:48.354124 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "50cba947-cb5f-4cc8-85d3-642dff3b9b11", "tag": "30aca23c-efa6-4de5-8706-37d5adb501fd", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:48.354580 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-26c059e9-6fa9-4f9a-b9e2-c86d9d8af9e7 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:48.354986 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '50cba947-cb5f-4cc8-85d3-642dff3b9b11', 'tag': '30aca23c-efa6-4de5-8706-37d5adb501fd', 'status': 'completed', 'code': 200} Sep 16 16:25:48.372611 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-8f7a643a-eca4-481e-b947-9b4a967f8783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.374438 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-8f7a643a-eca4-481e-b947-9b4a967f8783 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=bafa01935144486cb747380ee210ccb9&device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 1097 time: 0.0589907 Sep 16 16:25:48.395328 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbaf2a6c-4d95-4316-9089-2210ba7a5c71 req-f206799b-4736-4772-9041-5bc5f4490177 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.397608 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bbaf2a6c-4d95-4316-9089-2210ba7a5c71 req-f206799b-4736-4772-9041-5bc5f4490177 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 944 time: 0.0558398 Sep 16 16:25:48.423061 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-c96a7401-e278-4880-8b03-67fcb5597de7 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=30aca23c-efa6-4de5-8706-37d5adb501fd HTTP/1.1" status: 200 len: 217 time: 0.0391843 Sep 16 16:25:48.441145 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bbaf2a6c-4d95-4316-9089-2210ba7a5c71 req-8fa486f1-5707-41ef-83cc-2b122214a1b8 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups?id=0940c86c-ca66-4447-ad40-4cc953555435&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372977 Sep 16 16:25:48.477232 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-7b624eb9-ddb3-404b-950e-6a0ddb534033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.478755 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-7b624eb9-ddb3-404b-950e-6a0ddb534033 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=12487de4-e994-4284-8ca2-3e5c64dab8fe HTTP/1.1" status: 200 len: 856 time: 0.0468044 Sep 16 16:25:48.529109 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-df867bc0-63f1-4a11-bc2c-d68ed206d343 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.530640 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-df867bc0-63f1-4a11-bc2c-d68ed206d343 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=2577e213-c4cb-4026-ab97-83e15eeef39e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0440693 Sep 16 16:25:48.617267 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41822) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:48.625127 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-c8ec0bed-762e-4838-8f0b-716032c4f8a5 service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848122 Sep 16 16:25:48.718258 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-4464f0d9-3e3d-41f8-a86f-94037c729166 service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845942 Sep 16 16:25:48.719827 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3b96641b-6a25-4ae5-9925-9514aed7348f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.802685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-544b486d-e3e4-47ec-a7f0-e97092a4e38e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.804668 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-544b486d-e3e4-47ec-a7f0-e97092a4e38e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=bafa01935144486cb747380ee210ccb9&device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 1097 time: 0.0416770 Sep 16 16:25:48.822273 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3b96641b-6a25-4ae5-9925-9514aed7348f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.827128 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3b96641b-6a25-4ae5-9925-9514aed7348f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.867790 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3b96641b-6a25-4ae5-9925-9514aed7348f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=63bdc2afab7440549dcfe40ae0be7fc8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2493312 Sep 16 16:25:48.868898 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b96641b-6a25-4ae5-9925-9514aed7348f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc7996b1-a7e1-46b2-97b7-e05ccb694089,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:48.871829 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41826) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:48.917846 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-c1d9e733-a031-4afc-8b4c-1a098375c12a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:48.919426 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-c1d9e733-a031-4afc-8b4c-1a098375c12a service neutron] 10.222.0.66 "GET /v2.0/networks?id=2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 200 len: 918 time: 0.1066265 Sep 16 16:25:48.919541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-05f1623f-bc9b-460f-9c4f-2775b005b85d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.940959 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-05f1623f-bc9b-460f-9c4f-2775b005b85d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:48.962348 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-6fd79c7e-c880-4be9-83c2-481961e64c34 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=30aca23c-efa6-4de5-8706-37d5adb501fd HTTP/1.1" status: 200 len: 217 time: 0.0348127 Sep 16 16:25:49.007120 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-05f1623f-bc9b-460f-9c4f-2775b005b85d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:49.009635 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-05f1623f-bc9b-460f-9c4f-2775b005b85d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:49.013071 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-05f1623f-bc9b-460f-9c4f-2775b005b85d admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/dc7996b1-a7e1-46b2-97b7-e05ccb694089 HTTP/1.1" status: 204 len: 168 time: 0.1375537 Sep 16 16:25:49.021892 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f1623f-bc9b-460f-9c4f-2775b005b85d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc7996b1-a7e1-46b2-97b7-e05ccb694089,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:49.022618 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-e116581f-afc2-4d31-afd4-ccef25939cc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:49.027246 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-e116581f-afc2-4d31-afd4-ccef25939cc5 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=12487de4-e994-4284-8ca2-3e5c64dab8fe HTTP/1.1" status: 200 len: 856 time: 0.0459070 Sep 16 16:25:49.064830 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4314e950-5629-46d6-939e-491e695a6608 req-9ab299ed-2fe1-4ef1-b6df-86eeaf9c3d3d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:49.066496 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-9ab299ed-2fe1-4ef1-b6df-86eeaf9c3d3d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 944 time: 0.0878839 Sep 16 16:25:49.081132 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-85a0c233-9871-4b6c-ae98-4dc4d85a7086 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:49.083271 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-85a0c233-9871-4b6c-ae98-4dc4d85a7086 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=2577e213-c4cb-4026-ab97-83e15eeef39e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0501242 Sep 16 16:25:49.176625 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Deleting port 30aca23c-efa6-4de5-8706-37d5adb501fd {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:49.177782 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:49.195815 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-b7e578ac-56eb-4a56-80ae-09d2adeddb8c service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1037407 Sep 16 16:25:49.285586 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] For port 30aca23c-efa6-4de5-8706-37d5adb501fd, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=30aca23c-efa6-4de5-8706-37d5adb501fd,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:49.286119 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:49.300815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Calling delete_port for 30aca23c-efa6-4de5-8706-37d5adb501fd owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:49.326480 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c8af67-ba92-4ff4-ac34-a391e21a21d1 req-67aa1aac-44bf-4cbc-b0aa-f13c3707f6d9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:49.328032 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-90c8af67-ba92-4ff4-ac34-a391e21a21d1 req-67aa1aac-44bf-4cbc-b0aa-f13c3707f6d9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.1057048 Sep 16 16:25:49.358145 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-76c595e0-0fbc-45dc-a55e-ffd1cea3ab96 service neutron] 10.222.0.66 "GET /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1509972 Sep 16 16:25:49.377951 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-90c8af67-ba92-4ff4-ac34-a391e21a21d1 req-1cba93a6-8e01-4154-860b-5d3b0c8f976e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439939 Sep 16 16:25:49.442872 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:49.480004 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event deleted for resources: {'Port': ['ID=30aca23c-efa6-4de5-8706-37d5adb501fd,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:49.522616 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] No DVR routers for this DVR port 30aca23c-efa6-4de5-8706-37d5adb501fd on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:49.525588 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:49.528089 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-43fefe86-d441-44e9-a405-f201957e260d tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.66 "DELETE /v2.0/ports/30aca23c-efa6-4de5-8706-37d5adb501fd HTTP/1.1" status: 204 len: 173 time: 0.4546559 Sep 16 16:25:49.528638 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50cba947-cb5f-4cc8-85d3-642dff3b9b11', 'name': 'network-vif-deleted', 'tag': '30aca23c-efa6-4de5-8706-37d5adb501fd'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:25:49.532323 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f471e91-2d50-4f16-ad88-bb9b94ecf99b" -d '{"events": [{"server_uuid": "50cba947-cb5f-4cc8-85d3-642dff3b9b11", "name": "network-vif-deleted", "tag": "30aca23c-efa6-4de5-8706-37d5adb501fd"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:25:49.598564 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Thu, 16 Sep 2021 16:25:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06fc9bd2-3509-4e62-aa97-d3d2bdad51e0 x-openstack-request-id: req-06fc9bd2-3509-4e62-aa97-d3d2bdad51e0 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:25:49.598856 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50cba947-cb5f-4cc8-85d3-642dff3b9b11", "name": "network-vif-deleted", "tag": "30aca23c-efa6-4de5-8706-37d5adb501fd", "status": "failed", "code": 422}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:25:49.599107 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-06fc9bd2-3509-4e62-aa97-d3d2bdad51e0 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:25:49.599625 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '50cba947-cb5f-4cc8-85d3-642dff3b9b11', 'name': 'network-vif-deleted', 'tag': '30aca23c-efa6-4de5-8706-37d5adb501fd', 'status': 'failed', 'code': 422} returned with failed status Sep 16 16:25:49.601791 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-70e44201-4cee-4e9e-ac30-6199704090d8 req-254ea791-5244-41ac-820b-def3f3f5fc17 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 210 time: 0.0316699 Sep 16 16:25:49.923862 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-55bf7036-0b42-449f-bd0a-0d8a65aef3a1 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 210 time: 0.0256693 Sep 16 16:25:50.496991 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24d8e86-f959-4423-ad6f-e121d828b656 req-4fac55cf-2c9a-4ea3-b3b2-37639a7d7263 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:50.498573 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a24d8e86-f959-4423-ad6f-e121d828b656 req-4fac55cf-2c9a-4ea3-b3b2-37639a7d7263 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0518689 Sep 16 16:25:50.538267 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a24d8e86-f959-4423-ad6f-e121d828b656 req-1807d666-3da5-45cb-9cec-54972c5d3586 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334938 Sep 16 16:25:50.718960 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bcbd7cdc-31ba-4492-b59c-672377e33004 req-e470fd91-3828-4c2e-87a1-b22ebe802079 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 210 time: 0.0258734 Sep 16 16:25:50.721490 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4b751014-62e8-4e61-8ddd-000d953da596 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:50.871296 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ca827781-3fb9-47e5-89be-f4ed5389567e req-3a867255-a2d9-4e46-b1be-0fc4dafb23f0 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/ports?device_id=50cba947-cb5f-4cc8-85d3-642dff3b9b11 HTTP/1.1" status: 200 len: 210 time: 0.0265660 Sep 16 16:25:51.105443 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 41938) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:51.158616 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-925da569-4fa7-4773-8ab6-fc7b4511a009 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.184727 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-925da569-4fa7-4773-8ab6-fc7b4511a009 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.239516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-925da569-4fa7-4773-8ab6-fc7b4511a009 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.242209 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-925da569-4fa7-4773-8ab6-fc7b4511a009 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.243705 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-925da569-4fa7-4773-8ab6-fc7b4511a009 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "DELETE /v2.0/security-groups/0940c86c-ca66-4447-ad40-4cc953555435 HTTP/1.1" status: 204 len: 168 time: 0.1371782 Sep 16 16:25:51.246642 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41940) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:51.252957 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925da569-4fa7-4773-8ab6-fc7b4511a009 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0940c86c-ca66-4447-ad40-4cc953555435,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:51.261305 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.api.v2.resource [None req-1bd511de-6bb9-4172-b72c-6bc7db25c83c tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] show failed (client error): The resource could not be found. Sep 16 16:25:51.262360 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1bd511de-6bb9-4172-b72c-6bc7db25c83c tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "GET /v2.0/security-groups/0940c86c-ca66-4447-ad40-4cc953555435 HTTP/1.1" status: 404 len: 347 time: 0.0147228 Sep 16 16:25:51.265768 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41944) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:51.390985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Deleting port 504ab6db-326b-49ef-8840-d797f263aca4 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:51.391365 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.477853 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.478177 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.490687 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Calling delete_port for 504ab6db-326b-49ef-8840-d797f263aca4 owned by network:floatingip {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:51.624819 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.658119 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Pushing event deleted for resources: {'Port': ['ID=504ab6db-326b-49ef-8840-d797f263aca4,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:51.674560 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c292b7-7316-4c20-a84e-0c593f3f9772 req-fe561cfa-8b48-4b50-bcee-507f8315a169 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:51.676417 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5c292b7-7316-4c20-a84e-0c593f3f9772 req-fe561cfa-8b48-4b50-bcee-507f8315a169 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0592268 Sep 16 16:25:51.730401 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks [] for floatingip, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.732979 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:51.733970 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5c292b7-7316-4c20-a84e-0c593f3f9772 req-7c33067e-03ab-493c-a189-720e839ffb83 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474095 Sep 16 16:25:51.734424 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-181dd680-10a6-45c6-9935-840eddca2155 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] 10.222.0.59 "DELETE /v2.0/floatingips/832b1531-4e7b-456c-b7a3-ec7a519370c3 HTTP/1.1" status: 204 len: 168 time: 0.4672925 Sep 16 16:25:51.743262 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41960) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:52.106453 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:52.574952 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Deleting port f457f757-3e3b-4e45-9016-a30d2863653c {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:52.575651 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:52.653529 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] For port f457f757-3e3b-4e45-9016-a30d2863653c, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=f457f757-3e3b-4e45-9016-a30d2863653c,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:52.653954 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:52.665841 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Calling delete_port for f457f757-3e3b-4e45-9016-a30d2863653c owned by network:router_interface {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:52.877617 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b026b3-1b15-4ae9-91b1-3a7a6344861d req-8a6090ac-1067-43ad-87e2-afa7e6aef135 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:52.879108 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f8b026b3-1b15-4ae9-91b1-3a7a6344861d req-8a6090ac-1067-43ad-87e2-afa7e6aef135 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0848985 Sep 16 16:25:52.880270 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:52.911816 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Pushing event deleted for resources: {'Port': ['ID=f457f757-3e3b-4e45-9016-a30d2863653c,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:52.971925 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f8b026b3-1b15-4ae9-91b1-3a7a6344861d req-e01596e8-9c7e-4632-a950-fff54d0ec0af tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676687 Sep 16 16:25:53.120638 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.334379 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Router d52237e7-3781-41ad-9236-c7e649e67a9d has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:25:53.439797 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:25:53.444997 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c7f81140-840f-4596-b823-8b1e1ca6e962 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.447919 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-64af50f8-5d72-4900-9f6f-85802ac555bf admin admin] 10.222.0.59 "PUT /v2.0/routers/d52237e7-3781-41ad-9236-c7e649e67a9d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7062235 Sep 16 16:25:53.450059 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41982) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:53.452677 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] Sync routers for ids ['d52237e7-3781-41ad-9236-c7e649e67a9d'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:25:53.465513 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] Routers {'d52237e7-3781-41ad-9236-c7e649e67a9d'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:53.466161 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['d52237e7-3781-41ad-9236-c7e649e67a9d'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:53.561515 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks [] for router, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.577551 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] Set router d52237e7-3781-41ad-9236-c7e649e67a9d gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:53.663911 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.720326 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Deleting port 202f08bf-86f8-4762-b351-62fe1969aa8b {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:53.720733 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.761260 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.781701 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:52Z', 'revision_number': 5, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port': {'id': '202f08bf-86f8-4762-b351-62fe1969aa8b', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:bb:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:53.804131 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] For port 202f08bf-86f8-4762-b351-62fe1969aa8b, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=202f08bf-86f8-4762-b351-62fe1969aa8b,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:53.804515 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.812839 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] Checking router: d52237e7-3781-41ad-9236-c7e649e67a9d for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:25:53.817299 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Calling delete_port for 202f08bf-86f8-4762-b351-62fe1969aa8b owned by network:router_gateway {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:53.821140 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] Routers {'d52237e7-3781-41ad-9236-c7e649e67a9d'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:25:53.821741 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:25:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['d52237e7-3781-41ad-9236-c7e649e67a9d'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:53.906461 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] Set router d52237e7-3781-41ad-9236-c7e649e67a9d gateway port host: None {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:25:53.964049 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:53Z', 'revision_number': 6, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:53.989299 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:53.989668 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b851e574-205d-4ef7-b07e-d62035ef3ad4 None None] The sync data for ids ['d52237e7-3781-41ad-9236-c7e649e67a9d'] in dv-cinder-805887-15-iscsi is: [{'id': 'd52237e7-3781-41ad-9236-c7e649e67a9d', 'name': 'tempest-AttachVolumeShelveTestJSON-1929771121-router', 'tenant_id': 'bafa01935144486cb747380ee210ccb9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:25:27Z', 'updated_at': '2021-09-16T16:25:53Z', 'revision_number': 6, 'project_id': 'bafa01935144486cb747380ee210ccb9', 'gw_port_host': None}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:25:54.016891 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Pushing event deleted for resources: {'Port': ['ID=202f08bf-86f8-4762-b351-62fe1969aa8b,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:54.086439 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.109827 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3196e76-3fde-4136-a207-72b3a5b36755 req-130049ea-63ec-46b9-9943-237d28320315 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:54.115893 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3196e76-3fde-4136-a207-72b3a5b36755 req-130049ea-63ec-46b9-9943-237d28320315 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0577238 Sep 16 16:25:54.152226 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3196e76-3fde-4136-a207-72b3a5b36755 req-6804ed99-0df9-4961-9e51-6051f89f5d15 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342312 Sep 16 16:25:54.198271 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.205428 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.263310 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.263868 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d52237e7-3781-41ad-9236-c7e649e67a9d {{(pid=93950) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:25:54.268777 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.270259 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-617c08f4-2be0-40b2-94a6-7d3d70bdb456 admin admin] 10.222.0.59 "DELETE /v2.0/routers/d52237e7-3781-41ad-9236-c7e649e67a9d HTTP/1.1" status: 204 len: 168 time: 0.8191133 Sep 16 16:25:54.273220 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 41996) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:54.317143 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Deleting subnet 12487de4-e994-4284-8ca2-3e5c64dab8fe {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:25:54.321231 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.357149 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.373856 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.446226 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.497912 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.523268 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12487de4-e994-4284-8ca2-3e5c64dab8fe,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:54.527303 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.531967 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42000) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:54.533477 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1e27d25a-fd4a-4ae7-b589-c2bbe792745c admin admin] 10.222.0.59 "DELETE /v2.0/subnets/12487de4-e994-4284-8ca2-3e5c64dab8fe HTTP/1.1" status: 204 len: 168 time: 0.2591138 Sep 16 16:25:54.536486 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00961ca0-111e-4990-afbc-bf962bc1257d None None] Network 2577e213-c4cb-4026-ab97-83e15eeef39e requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:25:54.605243 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.657244 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Deleting port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:54.657589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.723165 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] For port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,segment=NetworkSegment(4c0fb585-da88-48c0-976a-40a4f44418a6),segment_id=4c0fb585-da88-48c0-976a-40a4f44418a6)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:54.723572 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.736068 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Calling delete_port for 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 owned by network:dhcp {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:54.768157 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] DHCP port deletion for 2577e213-c4cb-4026-ab97-83e15eeef39e request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:25:54.816568 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Deleting port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 {{(pid=93952) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:25:54.817048 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.818660 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.844825 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Pushing event deleted for resources: {'Port': ['ID=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:54.850027 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] No DVR routers for this DVR port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 on host dv-cinder-805887-15-iscsi {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:54.880023 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] For port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2, host dv-cinder-805887-15-iscsi, got binding levels [] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:25:54.880545 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.898616 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Calling delete_port for 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 owned by network:dhcp {{(pid=93952) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:25:54.901321 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.ipam_backend_mixin [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 was not found and therefore no delete operation was performed {{(pid=93952) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Sep 16 16:25:54.902522 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147'] for port, after_delete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.924756 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.928354 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] Pushing event deleted for resources: {'Port': ['ID=13ad372b-991b-4e2b-a181-4cd4b4a3eda2,revision_number=None']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:54.930930 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c88b6b27-a7d2-4b4b-b342-639df5901c42 None None] No DVR routers for this DVR port 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 on host dv-cinder-805887-15-iscsi {{(pid=93952) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:25:54.950471 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2577e213-c4cb-4026-ab97-83e15eeef39e']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:54.960421 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c0fb585-da88-48c0-976a-40a4f44418a6') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:54.960717 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c0fb585-da88-48c0-976a-40a4f44418a6') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:25:54.970936 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.984689 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.991483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Releasing vlan 709 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:25:54.991821 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:25:54.993274 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:25:55.051719 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:55.056949 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:55.058755 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] 10.222.0.59 "DELETE /v2.0/networks/2577e213-c4cb-4026-ab97-83e15eeef39e HTTP/1.1" status: 204 len: 168 time: 0.5255878 Sep 16 16:25:55.069401 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b79167f-184d-470e-9515-168c71f6d074 admin admin] Pushing event deleted for resources: {'Network': ['ID=2577e213-c4cb-4026-ab97-83e15eeef39e,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:55.229195 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42008) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:55.282453 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5e3cb084-7b64-4924-8810-e1ea55c050c3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=bafa01935144486cb747380ee210ccb9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0519185 Sep 16 16:25:55.285227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42014) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:55.335686 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b465478-f763-44be-a034-5b06bb8332b0 req-edc1be83-da73-4044-9aaa-0307ee2fa649 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:55.337237 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2b465478-f763-44be-a034-5b06bb8332b0 req-edc1be83-da73-4044-9aaa-0307ee2fa649 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0851793 Sep 16 16:25:55.370553 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a4103c29-572f-4800-82d8-82b503675083 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:55.403708 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a4103c29-572f-4800-82d8-82b503675083 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:55.413039 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2b465478-f763-44be-a034-5b06bb8332b0 req-5ef6c639-dad2-48eb-8aa3-b931bfb25aac tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679076 Sep 16 16:25:55.456757 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a4103c29-572f-4800-82d8-82b503675083 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:55.460143 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a4103c29-572f-4800-82d8-82b503675083 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:55.461267 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a4103c29-572f-4800-82d8-82b503675083 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/fe33d266-87f2-4d16-bde6-2eee6a0f0794 HTTP/1.1" status: 204 len: 168 time: 0.1732543 Sep 16 16:25:55.468985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4103c29-572f-4800-82d8-82b503675083 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe33d266-87f2-4d16-bde6-2eee6a0f0794,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:55.774928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 202f08bf-86f8-4762-b351-62fe1969aa8b no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:55.794599 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 202f08bf-86f8-4762-b351-62fe1969aa8b {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:55.794942 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 202f08bf-86f8-4762-b351-62fe1969aa8b not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:55.795395 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:55.813538 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:55.814122 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 13ad372b-991b-4e2b-a181-4cd4b4a3eda2 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:55.814592 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f457f757-3e3b-4e45-9016-a30d2863653c no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:25:55.834378 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: f457f757-3e3b-4e45-9016-a30d2863653c {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:25:55.834721 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device f457f757-3e3b-4e45-9016-a30d2863653c not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:25:56.176398 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:56.544735 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727fbc60-e8f8-468b-952c-3017c6e3bc52 req-2c36392b-5f8d-4c1c-ad92-f044c31d1578 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:56.546400 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-727fbc60-e8f8-468b-952c-3017c6e3bc52 req-2c36392b-5f8d-4c1c-ad92-f044c31d1578 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0604224 Sep 16 16:25:56.600031 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-727fbc60-e8f8-468b-952c-3017c6e3bc52 req-c50e8bf0-c431-46ae-ab69-cb8027d00704 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444496 Sep 16 16:25:56.702672 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42066) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:56.806515 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-076dbc76-4f26-4284-a134-8679dfaa42e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:56.897701 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-076dbc76-4f26-4284-a134-8679dfaa42e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:56.902190 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-076dbc76-4f26-4284-a134-8679dfaa42e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:56.942308 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-076dbc76-4f26-4284-a134-8679dfaa42e1 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=414d37ca046d4f2facf1b06325c18923&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2358263 Sep 16 16:25:56.942308 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076dbc76-4f26-4284-a134-8679dfaa42e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0bb0364-7bfa-4e1b-9efe-65364c6a7308,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:56.947525 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42070) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:56.996958 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4baee069-bb7a-46b4-904e-260f2a4c4cf7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:57.018290 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4baee069-bb7a-46b4-904e-260f2a4c4cf7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:57.068720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4baee069-bb7a-46b4-904e-260f2a4c4cf7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:57.071624 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-4baee069-bb7a-46b4-904e-260f2a4c4cf7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:57.075352 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4baee069-bb7a-46b4-904e-260f2a4c4cf7 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d0bb0364-7bfa-4e1b-9efe-65364c6a7308 HTTP/1.1" status: 204 len: 168 time: 0.1241868 Sep 16 16:25:57.080478 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4baee069-bb7a-46b4-904e-260f2a4c4cf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0bb0364-7bfa-4e1b-9efe-65364c6a7308,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:57.730298 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ddd57e9-2389-4031-add0-f51b7f65c621 req-a96ce08f-1ba3-44bd-b90d-37c114a70d6b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:57.732173 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7ddd57e9-2389-4031-add0-f51b7f65c621 req-a96ce08f-1ba3-44bd-b90d-37c114a70d6b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0585794 Sep 16 16:25:57.770884 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7ddd57e9-2389-4031-add0-f51b7f65c621 req-9b2c5e3f-bec0-4c1b-8e59-0ebfbbaf4269 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327077 Sep 16 16:25:58.892786 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd0482c9-b3d4-4dc3-851f-9496216e7e8b req-696da7cc-0d98-4da4-8549-1e4588fc276d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:25:58.894239 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fd0482c9-b3d4-4dc3-851f-9496216e7e8b req-696da7cc-0d98-4da4-8549-1e4588fc276d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0493693 Sep 16 16:25:58.945238 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-fd0482c9-b3d4-4dc3-851f-9496216e7e8b req-f6a006aa-fa32-47bf-8fa9-e55a1eee802d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450928 Sep 16 16:25:59.236336 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42110) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:59.354722 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-686c9642-68bf-4569-a416-19e7bcc56cdc admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.448666 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-686c9642-68bf-4569-a416-19e7bcc56cdc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.452492 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-686c9642-68bf-4569-a416-19e7bcc56cdc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.498788 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-686c9642-68bf-4569-a416-19e7bcc56cdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c410b821-a221-425a-9087-295af574c073,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:25:59.505359 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-686c9642-68bf-4569-a416-19e7bcc56cdc admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=90b3cd7daf7d491a8d2b2aa8a7bf9938&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2679253 Sep 16 16:25:59.509295 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42116) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:25:59.563382 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d1da7453-9614-458a-8814-9a96931fecab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.583869 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d1da7453-9614-458a-8814-9a96931fecab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.631185 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d1da7453-9614-458a-8814-9a96931fecab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.633847 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d1da7453-9614-458a-8814-9a96931fecab admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:25:59.634995 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-d1da7453-9614-458a-8814-9a96931fecab admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c410b821-a221-425a-9087-295af574c073 HTTP/1.1" status: 204 len: 168 time: 0.1247807 Sep 16 16:25:59.645625 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1da7453-9614-458a-8814-9a96931fecab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c410b821-a221-425a-9087-295af574c073,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:00.060595 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40f1840-ffd2-4a1d-a84f-487560a7d10d req-72ed8054-b9cd-4913-ba84-90f01e2ec8d1 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:00.062145 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e40f1840-ffd2-4a1d-a84f-487560a7d10d req-72ed8054-b9cd-4913-ba84-90f01e2ec8d1 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0506842 Sep 16 16:26:00.102595 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e40f1840-ffd2-4a1d-a84f-487560a7d10d req-bd051abe-2758-47c8-92d4-ccf7f811e02e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330503 Sep 16 16:26:01.234106 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ab63d2-ff13-4b87-997f-d25a04cc36c5 req-b62c489b-89ee-4c44-998b-3b8cccc1b7e7 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:01.235561 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f3ab63d2-ff13-4b87-997f-d25a04cc36c5 req-b62c489b-89ee-4c44-998b-3b8cccc1b7e7 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0557797 Sep 16 16:26:01.272054 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42176) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:01.281966 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f3ab63d2-ff13-4b87-997f-d25a04cc36c5 req-6aecf1e0-30c8-4898-a195-72be72750d99 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385747 Sep 16 16:26:01.377355 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7456cb6a-2c3f-487a-8093-bf328364563d admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.469585 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7456cb6a-2c3f-487a-8093-bf328364563d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.474290 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7456cb6a-2c3f-487a-8093-bf328364563d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.512140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7456cb6a-2c3f-487a-8093-bf328364563d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27872c06-739d-4d5f-a1d1-06f29d867569,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:01.517469 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7456cb6a-2c3f-487a-8093-bf328364563d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=fff13d8508f149e4b3548644021bdcce&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2443545 Sep 16 16:26:01.520099 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42180) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:01.569838 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a09a6792-48dd-4099-9f22-cc4e6046fe6c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.590815 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a09a6792-48dd-4099-9f22-cc4e6046fe6c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.640097 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a09a6792-48dd-4099-9f22-cc4e6046fe6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.643042 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a09a6792-48dd-4099-9f22-cc4e6046fe6c admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:01.644261 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a09a6792-48dd-4099-9f22-cc4e6046fe6c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/27872c06-739d-4d5f-a1d1-06f29d867569 HTTP/1.1" status: 204 len: 168 time: 0.1232276 Sep 16 16:26:01.652272 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a09a6792-48dd-4099-9f22-cc4e6046fe6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27872c06-739d-4d5f-a1d1-06f29d867569,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:01.906336 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42188) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:01.919758 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69d7bca9-5d64-4b24-9dba-077dbdeb98e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.012203 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69d7bca9-5d64-4b24-9dba-077dbdeb98e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.015954 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-69d7bca9-5d64-4b24-9dba-077dbdeb98e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.055640 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-69d7bca9-5d64-4b24-9dba-077dbdeb98e4 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c240a3404ef641a3b725ebaebd78e5fc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1482339 Sep 16 16:26:02.056847 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d7bca9-5d64-4b24-9dba-077dbdeb98e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e320cb7d-311e-46f2-8bcb-e39c462d9296,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:02.058283 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42196) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:02.107387 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cb192497-ed55-4a23-ae74-f068ba150f8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.127723 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cb192497-ed55-4a23-ae74-f068ba150f8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.173227 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cb192497-ed55-4a23-ae74-f068ba150f8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.175701 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-cb192497-ed55-4a23-ae74-f068ba150f8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:02.176840 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-cb192497-ed55-4a23-ae74-f068ba150f8b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e320cb7d-311e-46f2-8bcb-e39c462d9296 HTTP/1.1" status: 204 len: 168 time: 0.1175036 Sep 16 16:26:02.183826 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb192497-ed55-4a23-ae74-f068ba150f8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e320cb7d-311e-46f2-8bcb-e39c462d9296,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:02.401130 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785cdfe4-b430-409a-b043-9073bc9f00a8 req-8f143949-fa4c-47c5-bccc-7855b8f175d9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:02.403247 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-785cdfe4-b430-409a-b043-9073bc9f00a8 req-8f143949-fa4c-47c5-bccc-7855b8f175d9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0517826 Sep 16 16:26:02.440997 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-785cdfe4-b430-409a-b043-9073bc9f00a8 req-387c08ec-887b-47f3-a2b4-4b82885fe516 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319796 Sep 16 16:26:03.559251 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a24216f-2c93-4db1-98f9-9d6cbecfad4f req-1e2e5df8-ba60-4ac7-a44f-72c15c9a1a1c tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:03.560734 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2a24216f-2c93-4db1-98f9-9d6cbecfad4f req-1e2e5df8-ba60-4ac7-a44f-72c15c9a1a1c tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0479801 Sep 16 16:26:03.598231 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2a24216f-2c93-4db1-98f9-9d6cbecfad4f req-85187ca1-cb3e-46f8-b0cc-cede05d2f626 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313439 Sep 16 16:26:04.049342 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:26:04.709531 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2a1313f-4873-4f0e-a3f7-4a9f4aee9b1e req-f43b64b0-25b1-4536-bed7-4a8a4fb5f54b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:04.710981 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b2a1313f-4873-4f0e-a3f7-4a9f4aee9b1e req-f43b64b0-25b1-4536-bed7-4a8a4fb5f54b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0471096 Sep 16 16:26:04.747478 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b2a1313f-4873-4f0e-a3f7-4a9f4aee9b1e req-7c214b47-1f62-4827-9117-c165509fb70f tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300694 Sep 16 16:26:05.860814 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16427e19-4f28-4620-8af6-1842156001e4 req-4a129c0f-6978-4f26-9e28-1a7278ddc61a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:05.862279 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-16427e19-4f28-4620-8af6-1842156001e4 req-4a129c0f-6978-4f26-9e28-1a7278ddc61a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0505311 Sep 16 16:26:05.901404 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-16427e19-4f28-4620-8af6-1842156001e4 req-b13765af-918d-4886-8e98-3539e20c1aef tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327504 Sep 16 16:26:06.374014 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42300) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:06.475677 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e9ecb90a-91a5-4310-98d0-2590adfe7969 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.560734 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e9ecb90a-91a5-4310-98d0-2590adfe7969 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.564505 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e9ecb90a-91a5-4310-98d0-2590adfe7969 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.602337 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e9ecb90a-91a5-4310-98d0-2590adfe7969 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a73c133cdd014a17b3731f8027294317&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2272539 Sep 16 16:26:06.603245 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9ecb90a-91a5-4310-98d0-2590adfe7969 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4121586f-ce31-49b5-9387-75cfe178a8a0,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:06.605091 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42304) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:06.652544 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5b5e10a3-dc02-4dfe-b879-0f3cf852f579 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.672455 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5b5e10a3-dc02-4dfe-b879-0f3cf852f579 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.720486 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5b5e10a3-dc02-4dfe-b879-0f3cf852f579 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.722999 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5b5e10a3-dc02-4dfe-b879-0f3cf852f579 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:06.724143 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5b5e10a3-dc02-4dfe-b879-0f3cf852f579 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/4121586f-ce31-49b5-9387-75cfe178a8a0 HTTP/1.1" status: 204 len: 168 time: 0.1179945 Sep 16 16:26:06.731188 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5e10a3-dc02-4dfe-b879-0f3cf852f579 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4121586f-ce31-49b5-9387-75cfe178a8a0,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:06.980486 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42314) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:06.993877 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1b41557b-f599-4396-83ea-312fe0430b08 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.016304 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3adfc09-18f8-4bcb-a986-3dec58017424 req-9d3132c6-dacd-4906-b73f-3f98e04be73b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:07.017976 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c3adfc09-18f8-4bcb-a986-3dec58017424 req-9d3132c6-dacd-4906-b73f-3f98e04be73b tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0500164 Sep 16 16:26:07.054675 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c3adfc09-18f8-4bcb-a986-3dec58017424 req-3e97a516-08d9-486e-813f-0d551b00986d tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304797 Sep 16 16:26:07.083418 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1b41557b-f599-4396-83ea-312fe0430b08 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.087897 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1b41557b-f599-4396-83ea-312fe0430b08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.128550 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1b41557b-f599-4396-83ea-312fe0430b08 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=531f815398434093a31bf3f83aca8a94&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1468434 Sep 16 16:26:07.129422 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b41557b-f599-4396-83ea-312fe0430b08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1813ed6f-d28b-4da9-8de7-d11713933d23,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:07.131361 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42316) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:07.179161 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec8007b8-51d5-4cfa-a91a-baece490575b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.201227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec8007b8-51d5-4cfa-a91a-baece490575b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.247872 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec8007b8-51d5-4cfa-a91a-baece490575b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.250404 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec8007b8-51d5-4cfa-a91a-baece490575b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:07.251566 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-ec8007b8-51d5-4cfa-a91a-baece490575b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1813ed6f-d28b-4da9-8de7-d11713933d23 HTTP/1.1" status: 204 len: 168 time: 0.1192358 Sep 16 16:26:07.259657 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec8007b8-51d5-4cfa-a91a-baece490575b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1813ed6f-d28b-4da9-8de7-d11713933d23,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:08.170738 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f8f283-5bb3-47bb-b87d-75ae1544da95 req-3c2579d9-e194-40de-bb9e-1a70cee128d0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:08.172828 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a0f8f283-5bb3-47bb-b87d-75ae1544da95 req-3c2579d9-e194-40de-bb9e-1a70cee128d0 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0507784 Sep 16 16:26:08.210255 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a0f8f283-5bb3-47bb-b87d-75ae1544da95 req-adafab23-0292-450d-91a8-87f8bc7dc686 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318794 Sep 16 16:26:09.251471 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42404) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:09.327849 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ea18b6-63ba-423d-8c47-8eece7252aaa req-42fc5258-ea91-4392-bbc1-3ddbf5a21607 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:09.329339 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a3ea18b6-63ba-423d-8c47-8eece7252aaa req-42fc5258-ea91-4392-bbc1-3ddbf5a21607 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0530579 Sep 16 16:26:09.365305 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.385517 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a3ea18b6-63ba-423d-8c47-8eece7252aaa req-c3bc24c0-628e-4d69-b112-230f03b13792 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503597 Sep 16 16:26:09.463024 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.466618 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.508793 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ec8b603b887240a0a44c847d149f5712&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2562339 Sep 16 16:26:09.509732 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5626e0ec-c76d-4d2b-a7d2-05f488759fd7,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:09.511617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42408) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:09.516884 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.517241 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.517575 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.517906 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.518236 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.518566 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.518891 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.519227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.519567 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.519887 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.520206 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.520523 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a17c2296-9361-49fd-a4a2-6d5cc89cde88 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:09.561390 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ebb84b0b-0d6d-4afa-b9b2-e8acc7aa6779 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.581612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ebb84b0b-0d6d-4afa-b9b2-e8acc7aa6779 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.626507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ebb84b0b-0d6d-4afa-b9b2-e8acc7aa6779 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.629269 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ebb84b0b-0d6d-4afa-b9b2-e8acc7aa6779 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.630418 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-ebb84b0b-0d6d-4afa-b9b2-e8acc7aa6779 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/5626e0ec-c76d-4d2b-a7d2-05f488759fd7 HTTP/1.1" status: 204 len: 168 time: 0.1177034 Sep 16 16:26:09.645065 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb84b0b-0d6d-4afa-b9b2-e8acc7aa6779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5626e0ec-c76d-4d2b-a7d2-05f488759fd7,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:09.878219 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42416) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:09.891342 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a2da1682-d3f9-498d-a76d-edc38677026a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.986536 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a2da1682-d3f9-498d-a76d-edc38677026a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:09.990715 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a2da1682-d3f9-498d-a76d-edc38677026a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:10.028373 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a2da1682-d3f9-498d-a76d-edc38677026a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=2da43391395c42d492c80e0b685dd9d7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1491191 Sep 16 16:26:10.029574 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2da1682-d3f9-498d-a76d-edc38677026a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65a832e6-31ef-4bb2-9235-97c3e5d5352e,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:10.031038 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42418) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:10.079102 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-832cbcf7-c108-4f0b-bd2f-1b7bb669aeb9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:10.100421 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-832cbcf7-c108-4f0b-bd2f-1b7bb669aeb9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:10.149612 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-832cbcf7-c108-4f0b-bd2f-1b7bb669aeb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:10.152068 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-832cbcf7-c108-4f0b-bd2f-1b7bb669aeb9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:10.153170 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-832cbcf7-c108-4f0b-bd2f-1b7bb669aeb9 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/65a832e6-31ef-4bb2-9235-97c3e5d5352e HTTP/1.1" status: 204 len: 168 time: 0.1210933 Sep 16 16:26:10.160406 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832cbcf7-c108-4f0b-bd2f-1b7bb669aeb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65a832e6-31ef-4bb2-9235-97c3e5d5352e,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:10.499832 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680efee2-4025-488e-93b5-357639c6b367 req-9da9c287-5953-48bc-b01b-9d081f6e206e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:10.503993 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-680efee2-4025-488e-93b5-357639c6b367 req-9da9c287-5953-48bc-b01b-9d081f6e206e tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0478148 Sep 16 16:26:10.539344 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-680efee2-4025-488e-93b5-357639c6b367 req-340f963f-fd0b-4a41-af5f-0a877dee2659 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321243 Sep 16 16:26:11.147562 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42456) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:11.259598 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0fd318be-7dcf-4c64-99f4-2aed4e84d13f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.345746 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0fd318be-7dcf-4c64-99f4-2aed4e84d13f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.349285 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0fd318be-7dcf-4c64-99f4-2aed4e84d13f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.384855 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd318be-7dcf-4c64-99f4-2aed4e84d13f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a580500-54fb-4a64-b3a7-6055aeff0142,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:11.389117 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0fd318be-7dcf-4c64-99f4-2aed4e84d13f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6d924e0b460b4883bc754b27c43a9871&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2404318 Sep 16 16:26:11.392304 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42460) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:11.439605 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a0e8b11-bba0-44c2-9ffc-b762b3772b56 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.459898 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a0e8b11-bba0-44c2-9ffc-b762b3772b56 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.505663 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a0e8b11-bba0-44c2-9ffc-b762b3772b56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.509216 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3a0e8b11-bba0-44c2-9ffc-b762b3772b56 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:11.510411 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3a0e8b11-bba0-44c2-9ffc-b762b3772b56 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0a580500-54fb-4a64-b3a7-6055aeff0142 HTTP/1.1" status: 204 len: 168 time: 0.1177616 Sep 16 16:26:11.518068 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0e8b11-bba0-44c2-9ffc-b762b3772b56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a580500-54fb-4a64-b3a7-6055aeff0142,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:11.655439 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bab10ca-b042-45ee-b5e3-8064af2c6cb0 req-9cb13ef4-5e9d-4433-a7b9-839c4a05de06 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:11.656951 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1bab10ca-b042-45ee-b5e3-8064af2c6cb0 req-9cb13ef4-5e9d-4433-a7b9-839c4a05de06 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0509076 Sep 16 16:26:11.693522 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1bab10ca-b042-45ee-b5e3-8064af2c6cb0 req-1c1d1933-8d0b-4a12-b372-bd13f14b3a19 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306022 Sep 16 16:26:12.817342 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74fc7239-1ede-4bc5-8852-2725b4c625ac req-3b28f5dc-48ae-49f0-ac19-e0c7c0e6de88 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:12.818804 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-74fc7239-1ede-4bc5-8852-2725b4c625ac req-3b28f5dc-48ae-49f0-ac19-e0c7c0e6de88 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0514338 Sep 16 16:26:12.855276 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-74fc7239-1ede-4bc5-8852-2725b4c625ac req-87d5027a-d72e-4517-aec4-5181da8ce991 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306625 Sep 16 16:26:13.968266 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d43bf0-ac63-4874-b938-a62255e232eb req-50e45be0-a38c-432c-8fb4-b5d68955aecb tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:13.969746 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-45d43bf0-ac63-4874-b938-a62255e232eb req-50e45be0-a38c-432c-8fb4-b5d68955aecb tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0492578 Sep 16 16:26:14.005938 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-45d43bf0-ac63-4874-b938-a62255e232eb req-c60def37-b161-4452-923e-2ef77f185213 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302317 Sep 16 16:26:15.122123 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b939618b-28e4-49c4-9e70-2274a56165ac req-a8701f85-77f2-4e05-a605-7672868b88f3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:15.123578 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b939618b-28e4-49c4-9e70-2274a56165ac req-a8701f85-77f2-4e05-a605-7672868b88f3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0517745 Sep 16 16:26:15.159662 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b939618b-28e4-49c4-9e70-2274a56165ac req-ced58234-27f9-45c3-aea3-8a4f68f52543 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302050 Sep 16 16:26:15.671377 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:16.276716 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4cc0bc-ec86-4f7a-87be-d74d3361e4b0 req-f64e1278-9b17-4fdf-b882-b1b0c6538db2 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:16.278157 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4c4cc0bc-ec86-4f7a-87be-d74d3361e4b0 req-f64e1278-9b17-4fdf-b882-b1b0c6538db2 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0475955 Sep 16 16:26:16.315929 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4c4cc0bc-ec86-4f7a-87be-d74d3361e4b0 req-af6edb80-50d3-47f7-a311-596977606808 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316575 Sep 16 16:26:17.426547 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f660bfc1-d2c3-428f-9385-719aa3da3172 req-5439c622-7a1c-4f3e-84f3-4054cdc5e911 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:17.428130 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f660bfc1-d2c3-428f-9385-719aa3da3172 req-5439c622-7a1c-4f3e-84f3-4054cdc5e911 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0473025 Sep 16 16:26:17.466580 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f660bfc1-d2c3-428f-9385-719aa3da3172 req-f40f689f-39b1-4188-8c4a-94184af07138 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319650 Sep 16 16:26:18.582972 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac34913-a27e-4142-ab54-00ed2be84e46 req-675ef46e-d52d-4d00-af85-feff0a6b9315 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:18.584886 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6ac34913-a27e-4142-ab54-00ed2be84e46 req-675ef46e-d52d-4d00-af85-feff0a6b9315 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0545783 Sep 16 16:26:18.623972 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-6ac34913-a27e-4142-ab54-00ed2be84e46 req-d67a6272-3432-46ca-992c-b63431c07ac3 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/security-groups?id=ddb3a6a7-7f18-4dc3-a328-46698c8b8430&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325735 Sep 16 16:26:19.122135 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9cb883ec-4945-419c-8b91-a10db6fae44a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:26:19.123614 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9cb883ec-4945-419c-8b91-a10db6fae44a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 943 time: 0.0498626 Sep 16 16:26:19.216067 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Deleting port 7394feb1-3144-433b-bf8b-cff90d88c5fb {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:26:19.216409 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:19.302384 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] For port 7394feb1-3144-433b-bf8b-cff90d88c5fb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=7394feb1-3144-433b-bf8b-cff90d88c5fb,segment=NetworkSegment(dd570390-2af3-48dd-9731-814c63fe3614),segment_id=dd570390-2af3-48dd-9731-814c63fe3614)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:26:19.302743 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:19.316322 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Calling delete_port for 7394feb1-3144-433b-bf8b-cff90d88c5fb owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:26:19.443198 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:19.470684 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Pushing event deleted for resources: {'Port': ['ID=7394feb1-3144-433b-bf8b-cff90d88c5fb,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:19.502321 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.502665 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.503001 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.503357 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.503702 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.504016 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.504339 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.504660 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.504983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.505302 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.505622 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.505940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:26:19.530640 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] No DVR routers for this DVR port 7394feb1-3144-433b-bf8b-cff90d88c5fb on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:26:19.533189 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:19.535142 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2c5192a4-9f82-423b-b450-e66659bdfd98 req-9d1220e3-38b5-439e-8854-b38fa9554174 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.66 "DELETE /v2.0/ports/7394feb1-3144-433b-bf8b-cff90d88c5fb HTTP/1.1" status: 204 len: 173 time: 0.4053977 Sep 16 16:26:19.535619 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c71b7513-9f0d-4464-85af-085977775e81', 'name': 'network-vif-deleted', 'tag': '7394feb1-3144-433b-bf8b-cff90d88c5fb'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:26:19.537940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc21d5df-6b68-4b5f-a258-b19df3aeabbf" -d '{"events": [{"server_uuid": "c71b7513-9f0d-4464-85af-085977775e81", "name": "network-vif-deleted", "tag": "7394feb1-3144-433b-bf8b-cff90d88c5fb"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:26:19.575903 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Thu, 16 Sep 2021 16:26:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42f39c81-02c2-4e4f-b716-eb305134e982 x-openstack-request-id: req-42f39c81-02c2-4e4f-b716-eb305134e982 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:26:19.576191 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c71b7513-9f0d-4464-85af-085977775e81", "name": "network-vif-deleted", "tag": "7394feb1-3144-433b-bf8b-cff90d88c5fb", "status": "failed", "code": 422}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:26:19.576437 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-42f39c81-02c2-4e4f-b716-eb305134e982 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:26:19.576838 dv-cinder-805887-15-iscsi neutron-server[93951]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'c71b7513-9f0d-4464-85af-085977775e81', 'name': 'network-vif-deleted', 'tag': '7394feb1-3144-433b-bf8b-cff90d88c5fb', 'status': 'failed', 'code': 422} returned with failed status Sep 16 16:26:19.747502 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-84dbc264-d2e8-41bd-a859-15be7e19b0b6 req-d06789c6-4508-48c8-a7c2-831b0e483af9 tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 210 time: 0.0512755 Sep 16 16:26:20.723258 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-7654b2d7-3ac6-4032-8e8d-d7583bced736 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:20.856682 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7f65461-ab41-4422-8ea5-44221b441d83 req-ae7cdbf8-66bc-425f-ba96-edd0b27054ff tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 210 time: 0.0256755 Sep 16 16:26:20.997368 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a47b40b1-bc2a-4a0b-86e3-335418d426d2 req-348eb9d9-45a8-452a-b014-418e3369433a tempest-VolumesSnapshotTestJSON-2062538722 tempest-VolumesSnapshotTestJSON-2062538722-project] 10.222.0.59 "GET /v2.0/ports?device_id=c71b7513-9f0d-4464-85af-085977775e81 HTTP/1.1" status: 200 len: 210 time: 0.0260048 Sep 16 16:26:23.439780 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8a9ecba7-11b5-4fd7-94e9-69422b621f6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:23.723590 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:24.367694 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:26.178313 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.261748 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42836) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:38.363109 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-99d4fd77-1fbe-41b1-942a-5432172be78b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.448295 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-99d4fd77-1fbe-41b1-942a-5432172be78b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.451670 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-99d4fd77-1fbe-41b1-942a-5432172be78b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.489199 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99d4fd77-1fbe-41b1-942a-5432172be78b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b9a4847-9045-47b1-b61f-ade2ae2bc6ff,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:38.493361 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-99d4fd77-1fbe-41b1-942a-5432172be78b admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=bf42c168aca44ae8a275148c41c8f1fb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2305691 Sep 16 16:26:38.497113 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42840) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:38.546425 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-af40e27c-de7e-43c3-9e15-5f02ec90f944 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.566333 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-af40e27c-de7e-43c3-9e15-5f02ec90f944 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.612000 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-af40e27c-de7e-43c3-9e15-5f02ec90f944 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.614618 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-af40e27c-de7e-43c3-9e15-5f02ec90f944 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:38.615914 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-af40e27c-de7e-43c3-9e15-5f02ec90f944 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/2b9a4847-9045-47b1-b61f-ade2ae2bc6ff HTTP/1.1" status: 204 len: 168 time: 0.1190431 Sep 16 16:26:38.623959 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af40e27c-de7e-43c3-9e15-5f02ec90f944 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b9a4847-9045-47b1-b61f-ade2ae2bc6ff,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:39.578119 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 42876) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:39.678997 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d90501e1-1769-4489-9a57-45dfa8b7fe1f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.766100 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d90501e1-1769-4489-9a57-45dfa8b7fe1f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.769406 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-d90501e1-1769-4489-9a57-45dfa8b7fe1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.804505 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-d90501e1-1769-4489-9a57-45dfa8b7fe1f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=dd45c406b4814324981d2a60a4b95489&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2253833 Sep 16 16:26:39.806367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90501e1-1769-4489-9a57-45dfa8b7fe1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1fd4f821-575a-4fc2-8a9c-6dd5e1003efa,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:39.807254 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42882) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:39.855355 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4e96c0ab-c1ce-4b43-a98d-39ae12810781 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.875507 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4e96c0ab-c1ce-4b43-a98d-39ae12810781 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.921122 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4e96c0ab-c1ce-4b43-a98d-39ae12810781 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.923581 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4e96c0ab-c1ce-4b43-a98d-39ae12810781 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:39.924683 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-4e96c0ab-c1ce-4b43-a98d-39ae12810781 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1fd4f821-575a-4fc2-8a9c-6dd5e1003efa HTTP/1.1" status: 204 len: 168 time: 0.1164625 Sep 16 16:26:39.931996 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e96c0ab-c1ce-4b43-a98d-39ae12810781 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1fd4f821-575a-4fc2-8a9c-6dd5e1003efa,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:41.047905 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:26:45.695928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:47.937375 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42942) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:48.040365 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1e9c94b8-c6f1-4a0a-8a10-39f8932ab764 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.129729 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1e9c94b8-c6f1-4a0a-8a10-39f8932ab764 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.134698 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1e9c94b8-c6f1-4a0a-8a10-39f8932ab764 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.172011 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9c94b8-c6f1-4a0a-8a10-39f8932ab764 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76d77d5f-03fd-4da9-912f-efd2cab901c6,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:48.177457 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1e9c94b8-c6f1-4a0a-8a10-39f8932ab764 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f31222d8a6204675a2b43ff0e4302399&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2387307 Sep 16 16:26:48.180179 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 42948) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:26:48.230411 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9364a1b4-9454-465a-aac5-8caa4dd2d96c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.252610 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9364a1b4-9454-465a-aac5-8caa4dd2d96c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.301294 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9364a1b4-9454-465a-aac5-8caa4dd2d96c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.303814 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-9364a1b4-9454-465a-aac5-8caa4dd2d96c admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:48.304970 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-9364a1b4-9454-465a-aac5-8caa4dd2d96c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/76d77d5f-03fd-4da9-912f-efd2cab901c6 HTTP/1.1" status: 204 len: 168 time: 0.1239078 Sep 16 16:26:48.313644 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9364a1b4-9454-465a-aac5-8caa4dd2d96c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76d77d5f-03fd-4da9-912f-efd2cab901c6,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:26:50.723894 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-be776396-1518-4ac9-a856-c57ba7e5b149 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:53.440552 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8313ad2e-c2c4-41e1-a11e-8d4c09206d73 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:53.725559 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:54.370089 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:26:56.181142 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:06.882050 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43068) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:27:06.924416 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_v2 [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Deleting subnet dd7da63f-e08a-4fc1-87c9-93051b7a7b60 {{(pid=93951) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:27:06.927301 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:06.963465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-58472601'] for subnet, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.000076 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.049190 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-58361729', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58434304'] for subnet, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.075898 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dd7da63f-e08a-4fc1-87c9-93051b7a7b60,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:27:07.077864 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.080314 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f89c3bcc-7641-41a2-9e1a-c3517e9f16bb admin admin] 10.222.0.59 "DELETE /v2.0/subnets/dd7da63f-e08a-4fc1-87c9-93051b7a7b60 HTTP/1.1" status: 204 len: 168 time: 0.1966724 Sep 16 16:27:07.082148 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43070) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:27:07.151565 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.227539 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.247394 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bbef521b-499c-40f5-ae34-4960093b92d7']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:27:07.256080 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dd570390-2af3-48dd-9731-814c63fe3614') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:27:07.256383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dd570390-2af3-48dd-9731-814c63fe3614') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:27:07.265321 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.278093 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.283743 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Releasing vlan 745 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:27:07.284126 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:27:07.285771 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:27:07.342331 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.347497 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.349288 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] 10.222.0.59 "DELETE /v2.0/networks/bbef521b-499c-40f5-ae34-4960093b92d7 HTTP/1.1" status: 204 len: 168 time: 0.2662497 Sep 16 16:27:07.360221 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccdce7e0-c89a-4344-8c90-9a7eaaa3d41e admin admin] Pushing event deleted for resources: {'Network': ['ID=bbef521b-499c-40f5-ae34-4960093b92d7,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:27:07.504672 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43076) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:27:07.541957 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-68a7c724-f0d2-4590-b5d6-ccf97eb99761 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6560ff6c16c54d39bd054561aad63a12&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0361116 Sep 16 16:27:07.544630 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43078) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:27:07.590429 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7543759c-5e38-4eb8-b629-78e2af3ff6f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.610685 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7543759c-5e38-4eb8-b629-78e2af3ff6f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.660674 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7543759c-5e38-4eb8-b629-78e2af3ff6f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.663229 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7543759c-5e38-4eb8-b629-78e2af3ff6f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:07.664416 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-7543759c-5e38-4eb8-b629-78e2af3ff6f1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/ddb3a6a7-7f18-4dc3-a328-46698c8b8430 HTTP/1.1" status: 204 len: 168 time: 0.1189127 Sep 16 16:27:07.673580 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7543759c-5e38-4eb8-b629-78e2af3ff6f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ddb3a6a7-7f18-4dc3-a328-46698c8b8430,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:27:15.155693 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4682fab-ffd1-4a54-90d7-f2d436ef74a8 req-633c13b9-61cf-496b-ac56-d1de6be4f4fe service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1543231 Sep 16 16:27:15.220799 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4682fab-ffd1-4a54-90d7-f2d436ef74a8 req-e7f8846f-01a1-43e2-ace3-bdc04efc3c4a service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0241423 Sep 16 16:27:15.264059 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4682fab-ffd1-4a54-90d7-f2d436ef74a8 req-83861b43-3b71-4fdf-9cab-f299549b2870 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0187254 Sep 16 16:27:15.354665 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4682fab-ffd1-4a54-90d7-f2d436ef74a8 req-a92111e7-4464-499a-bd78-8a9626abff23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:27:15.356702 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c4682fab-ffd1-4a54-90d7-f2d436ef74a8 req-a92111e7-4464-499a-bd78-8a9626abff23 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0865412 Sep 16 16:27:15.709402 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:18.046236 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:27:20.725693 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9c80d220-03f2-48aa-9951-9dffc83716db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:21.183439 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:27:21.276278 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:27:21.287125 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'port_id': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'mac_address': 'fa:16:3e:d5:53:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 737, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:27:21.322544 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:21.338299 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bffdae71-37f3-4fff-8a1f-24159107e4eb {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:27:21.356312 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:27:21.359847 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:21.407183 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=7']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:27:21.413915 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.414287 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.414632 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.414967 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.415333 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.415667 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.415993 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.416317 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.416655 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.416983 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.417305 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.417624 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:27:21.422770 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['bffdae71-37f3-4fff-8a1f-24159107e4eb'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:27:23.182455 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:27:23.231787 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port bffdae71-37f3-4fff-8a1f-24159107e4eb triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:27:23.232102 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:23.303508 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:23.325329 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:27:23.327545 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4dc3fee7-47ff-44e8-a67a-ad236f4ebff8" -d '{"events": [{"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-plugged", "status": "completed", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:27:23.339448 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:27:23.343402 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:23.368130 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:27:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d1e3eb0-ac78-444e-9e2e-f0b552609128 x-openstack-request-id: req-2d1e3eb0-ac78-444e-9e2e-f0b552609128 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:27:23.368421 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-plugged", "status": "completed", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:27:23.368677 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-2d1e3eb0-ac78-444e-9e2e-f0b552609128 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:27:23.369061 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'code': 200} Sep 16 16:27:23.394878 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=8']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:27:23.440423 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a8f1acef-28bd-476d-8695-86c6d4984a57 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:23.725851 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:24.373806 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:26.183462 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:45.724857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:50.725571 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-773cc1bc-2188-44d6-85a7-cdb4d6e2f739 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:53.440362 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-25860984-8dd2-4f49-ad3e-cc2800249730 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:53.726308 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:54.374288 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:27:55.045329 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:27:56.187043 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:15.045305 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-95225e01-0da9-4d1f-8cfb-030137aa9e8d service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0376534 Sep 16 16:28:15.102848 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-3179e435-2cc6-47f6-9918-98d2562871be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:28:15.104363 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-3179e435-2cc6-47f6-9918-98d2562871be service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1099 time: 0.0379059 Sep 16 16:28:15.208568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-b4de7775-2c6f-4cdb-bd2e-5a68a1bff5f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:28:15.210030 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-b4de7775-2c6f-4cdb-bd2e-5a68a1bff5f4 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0866535 Sep 16 16:28:15.272942 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-0f956656-4e6d-4902-898e-468c8e8c2afe service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 1001 time: 0.0552270 Sep 16 16:28:15.324528 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-effafc35-311d-4040-924e-6b8d19a7213e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:28:15.325800 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-effafc35-311d-4040-924e-6b8d19a7213e service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0447714 Sep 16 16:28:15.368393 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-bec16b04-faac-42c8-b57a-e0f6f6495d9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:28:15.370375 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-bec16b04-faac-42c8-b57a-e0f6f6495d9d service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0370963 Sep 16 16:28:15.454945 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-e1b7a19f-74ab-45ce-9f5a-eed14aa1eb64 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0782547 Sep 16 16:28:15.543501 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5c1cf5e9-b692-4432-90a9-cacf338551ac req-4117531a-d3ee-4d40-90d3-143268c22ce7 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816970 Sep 16 16:28:15.713580 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:20.725283 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-626365a9-4015-47ea-8500-505f59784de7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:23.440035 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9dbe2712-399c-4884-83c0-9be5ea152132 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:23.721909 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:24.378147 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:26.189394 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:32.044894 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:28:45.730995 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:50.725735 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c40ba7c1-cf57-4b6a-84e1-15d49ac2a66b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:53.440548 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f71f083f-a62c-4033-8697-12c9f9e79dd5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:53.722706 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:54.379698 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:28:56.195120 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:09.043482 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:29:15.745212 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:17.030215 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-584ad801-0a65-4a05-afff-5e83a61ca8a3 req-19c16678-12b7-448a-ab3d-83e2e7083983 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0259440 Sep 16 16:29:17.095169 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-584ad801-0a65-4a05-afff-5e83a61ca8a3 req-a82c6793-efb4-4905-8843-0cfa9f31e18e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0238352 Sep 16 16:29:17.131515 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-584ad801-0a65-4a05-afff-5e83a61ca8a3 req-f280f2fd-c7a2-4ed1-b88a-049ccf1e300a service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0179040 Sep 16 16:29:17.223706 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584ad801-0a65-4a05-afff-5e83a61ca8a3 req-347a80d5-7d26-4d93-b9f3-aefb6ffac568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:29:17.225157 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-584ad801-0a65-4a05-afff-5e83a61ca8a3 req-347a80d5-7d26-4d93-b9f3-aefb6ffac568 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0874312 Sep 16 16:29:20.725891 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f5f3e97d-6bd1-40d3-a7bf-d1bbbdfcd35e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:23.440857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-25c1a3fc-8895-4725-bbd4-c881e5b78658 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:23.728086 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:24.383068 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:26.197128 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:45.744946 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:46.042052 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:29:50.727780 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-daecca96-5fbd-4947-a6da-4f1dbe6d0aec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:53.440848 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3df65cb7-4f62-42da-bb1f-d0ba46881310 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:53.728012 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:54.385583 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:29:56.197604 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:15.765125 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:19.035967 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-d65f54c3-ec71-49d7-bb48-3d913d5a0d1d service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391114 Sep 16 16:30:19.094750 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-03ba33a5-8bb3-479c-a693-e3e87c78bddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:30:19.096194 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-03ba33a5-8bb3-479c-a693-e3e87c78bddb service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 1099 time: 0.0380950 Sep 16 16:30:19.199676 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-cd280377-4960-41d4-9dbe-5f31e5d8183c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:30:19.201132 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-cd280377-4960-41d4-9dbe-5f31e5d8183c service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0861731 Sep 16 16:30:19.266728 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-fd624426-1598-414d-b578-2144144765c3 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 200 len: 1001 time: 0.0584857 Sep 16 16:30:19.552100 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-c8450482-9cfa-4835-a4a4-3718f4e79249 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:30:19.553498 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-c8450482-9cfa-4835-a4a4-3718f4e79249 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.2804613 Sep 16 16:30:19.597140 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-76cfafb0-916c-4340-85dd-4a770b6993c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:30:19.598526 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-76cfafb0-916c-4340-85dd-4a770b6993c1 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0375397 Sep 16 16:30:19.687680 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-7becfe35-f0e2-4545-b987-10023ef651ad service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806806 Sep 16 16:30:19.774113 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4f83fd64-dddf-40c1-a07e-c6722cfc3838 req-a8882985-fee0-459e-92bc-4a78ab059069 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798714 Sep 16 16:30:20.728057 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-af1caf9b-579f-4c5c-aa3f-7aba0b7aa174 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:23.041723 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:30:23.440584 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-14f5b8dc-a5d6-4725-8fda-40282ab5a2f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:23.729560 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:24.388914 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:26.200587 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:45.779277 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:50.728576 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c591ba98-252c-46cd-b275-4f3f2d4c7aa6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:53.440565 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e2c562fd-cd18-47f4-b7dc-c67da4a333c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:53.732765 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:54.391612 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:30:56.203577 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:00.040563 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:31:15.775267 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:20.728589 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-05303658-1922-4adb-bd45-efe7b443c1ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:21.017986 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2d6143a-75f8-4623-8c53-eabe85ffbf42 req-4a731b27-2a25-475b-a9da-a6100105849c service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0258343 Sep 16 16:31:21.084507 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2d6143a-75f8-4623-8c53-eabe85ffbf42 req-e7803b14-339e-4f86-99df-3ea2829922b8 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0275106 Sep 16 16:31:21.120712 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2d6143a-75f8-4623-8c53-eabe85ffbf42 req-6413b30b-7a49-4b4f-94aa-47b8ae1168f9 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0186064 Sep 16 16:31:21.216755 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d6143a-75f8-4623-8c53-eabe85ffbf42 req-12b3314a-8c07-4d2d-8066-666d819979f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:31:21.218240 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2d6143a-75f8-4623-8c53-eabe85ffbf42 req-12b3314a-8c07-4d2d-8066-666d819979f9 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0914998 Sep 16 16:31:23.440986 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3b4c86d9-ffa3-4a0f-b84f-10267b3838fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:23.733955 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:24.393339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:26.206150 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:37.040514 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:31:45.777847 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:50.729702 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-aeb322ec-27e3-4b4b-a0fd-9e0e759b6338 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:52.873053 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51af3a2e-ac08-4176-84af-2eed984138b6 req-e1e9be0d-1ad9-466b-ba6d-5d6a0085537d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:31:52.874411 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-51af3a2e-ac08-4176-84af-2eed984138b6 req-e1e9be0d-1ad9-466b-ba6d-5d6a0085537d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0502744 Sep 16 16:31:52.911394 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-51af3a2e-ac08-4176-84af-2eed984138b6 req-be8d4a1a-e965-4e4c-991f-bda8dc6c1e71 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a35ea1a4-42a6-4e95-821b-d662c756858f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310318 Sep 16 16:31:53.323113 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-8fb67685-5d27-4151-83df-8829699b8aa4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:31:53.324547 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-8fb67685-5d27-4151-83df-8829699b8aa4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 946 time: 0.0468478 Sep 16 16:31:53.413743 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Deleting port bffdae71-37f3-4fff-8a1f-24159107e4eb {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:31:53.414082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.441057 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-181f80d1-0f18-4471-812d-869920877040 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.502377 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] For port bffdae71-37f3-4fff-8a1f-24159107e4eb, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=bffdae71-37f3-4fff-8a1f-24159107e4eb,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:31:53.502665 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.709685 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.710046 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.710363 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.l3_db [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Floating IP 55845680-24fb-4140-822e-5f3b77e51725 disassociated. External IP: 172.27.3.73, port: bffdae71-37f3-4fff-8a1f-24159107e4eb. Sep 16 16:31:53.710698 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Calling delete_port for bffdae71-37f3-4fff-8a1f-24159107e4eb owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:31:53.734257 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.833647 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:53.859989 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event deleted for resources: {'Port': ['ID=bffdae71-37f3-4fff-8a1f-24159107e4eb,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:53.871181 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.871545 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.871875 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.872200 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.872517 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.872834 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.873158 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.873662 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.873769 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.874050 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.874357 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.874664 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:53.979562 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Router da1aab41-d805-4a4f-a252-59e579ace211 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:31:54.061790 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d26e08bd-b8bc-4a87-9e92-e9aea817f269 req-39082628-93f3-4988-87ca-7eaa61c50b65 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d HTTP/1.1" status: 200 len: 210 time: 0.0827365 Sep 16 16:31:54.087958 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:31:54.098362 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:31:54.108161 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:31:54.108797 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:31:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:31:54.126439 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] No DVR routers for this DVR port bffdae71-37f3-4fff-8a1f-24159107e4eb on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:31:54.128968 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:54.130907 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6dc34411-a068-4c3c-bd55-11695c3ab452 req-fdf0d453-2cfe-40f2-a4ed-1b9ef04c7ac2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "DELETE /v2.0/ports/bffdae71-37f3-4fff-8a1f-24159107e4eb HTTP/1.1" status: 204 len: 173 time: 0.7998736 Sep 16 16:31:54.131433 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-deleted', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:31:54.133694 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c7b8d10-dec3-45e1-ab5d-0cb556279f39" -d '{"events": [{"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-deleted", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:31:54.220608 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:31:54.244391 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:31:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03cf47a8-136b-4b65-aa66-2de86775b5bf x-openstack-request-id: req-03cf47a8-136b-4b65-aa66-2de86775b5bf {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:31:54.244567 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d", "name": "network-vif-deleted", "tag": "bffdae71-37f3-4fff-8a1f-24159107e4eb", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:31:54.244803 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-03cf47a8-136b-4b65-aa66-2de86775b5bf {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:31:54.245193 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcb41b0d-ef46-4e0d-b8e0-2f047f9b769d', 'name': 'network-vif-deleted', 'tag': 'bffdae71-37f3-4fff-8a1f-24159107e4eb', 'status': 'completed', 'code': 200} Sep 16 16:31:54.397941 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:54.436285 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:31:54.460918 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:31:54.469349 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:31:54.469937 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:31:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:31:54.679393 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:31:54.881915 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:31:54.912347 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a727a34-f69a-4e64-a09f-95d38ae43fd7 None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:31:55.121069 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a92de432-3eb5-498d-b5dc-60eb880eaf6a None None] New status for floating IP 55845680-24fb-4140-822e-5f3b77e51725: DOWN {{(pid=93952) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:31:55.154608 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 43742) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:55.209846 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.231982 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.290737 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.293306 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.294468 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "DELETE /v2.0/security-groups/a35ea1a4-42a6-4e95-821b-d662c756858f HTTP/1.1" status: 204 len: 168 time: 0.1388283 Sep 16 16:31:55.297480 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43744) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:55.303905 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a35ea1a4-42a6-4e95-821b-d662c756858f,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:55.311484 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.311842 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.312185 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.312523 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.312804 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.api.v2.resource [None req-4fe525ae-9257-427b-ac46-825a34edca5f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] show failed (client error): The resource could not be found. Sep 16 16:31:55.312920 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.313182 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.313513 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.313931 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.314266 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.314592 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.314920 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.315263 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e8e8ccd-a721-4375-836f-ef9ffd32a98f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:31:55.317109 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-4fe525ae-9257-427b-ac46-825a34edca5f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups/a35ea1a4-42a6-4e95-821b-d662c756858f HTTP/1.1" status: 404 len: 347 time: 0.0182967 Sep 16 16:31:55.317676 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 43746) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:55.437379 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Deleting port 12bc727a-6c27-468c-a7c8-5d7247350d36 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:31:55.437723 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.728308 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.728641 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.740793 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Calling delete_port for 12bc727a-6c27-468c-a7c8-5d7247350d36 owned by network:floatingip {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:31:55.869032 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.894493 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event deleted for resources: {'Port': ['ID=12bc727a-6c27-468c-a7c8-5d7247350d36,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:55.951740 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.954223 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:55.955406 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e07c998f-3064-4c9b-a0bf-219a1e7a34f1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "DELETE /v2.0/floatingips/55845680-24fb-4140-822e-5f3b77e51725 HTTP/1.1" status: 204 len: 168 time: 0.6367886 Sep 16 16:31:56.208524 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:56.452496 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:31:56.472146 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: bffdae71-37f3-4fff-8a1f-24159107e4eb {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:31:56.472428 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device bffdae71-37f3-4fff-8a1f-24159107e4eb not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:31:57.383509 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 43752) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:57.388076 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1527875021', 'description': 'tempest-description--91601179'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:31:57.412608 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.491905 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.495186 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.525368 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.526544 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.1419868 Sep 16 16:31:57.528391 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35cf4b42-fdfd-4aa9-a697-9d712a0657a2 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a157f8a5-ad80-4bf2-a667-a317c3bce936,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:57.529499 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43754) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:57.534092 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'security_group_rule': {'security_group_id': 'a157f8a5-ad80-4bf2-a667-a317c3bce936', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:31:57.560726 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.613925 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.617335 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.631318 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38052b61-bcfb-4481-bd74-729e419d808e,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:57.640025 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.641231 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-008730db-511f-4dba-9dc0-f63f492a11bf tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1107488 Sep 16 16:31:57.643946 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43756) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:57.648274 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'security_group_rule': {'security_group_id': 'a157f8a5-ad80-4bf2-a667-a317c3bce936', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:31:57.674044 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.732258 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.735482 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.751841 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e5ad095-3923-4d56-b3cd-a2f693c71ecd,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:57.758465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.759831 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c32eb2f3-6cf6-4b33-9a62-c7cb5102536a tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1149111 Sep 16 16:31:57.762808 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 43758) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:31:57.767072 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:31:57.788078 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.879344 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:57.981111 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Allocated IP 172.27.3.106 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/16cb3c88-e60f-4467-b39d-840f94bd2dce) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:31:58.076991 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.112300 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.146956 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:31:58.150376 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:31:58.153821 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:31:58.179408 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'Port': ['ID=16cb3c88-e60f-4467-b39d-840f94bd2dce,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:58.240053 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.271758 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.462603 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.467060 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.534903 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'Port': ['ID=16cb3c88-e60f-4467-b39d-840f94bd2dce,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:31:58.542909 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.555554 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:31:58.557401 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-37723ee1-2941-443f-8fc6-66a8419b67d5 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7935994 Sep 16 16:31:58.700012 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7597325e-fbeb-4bdc-bc9b-26e7a6e23f2b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--1527875021&fields=id&tenant_id=36186b0d094344dbb7b6d93645ae77e1 HTTP/1.1" status: 200 len: 267 time: 0.0321767 Sep 16 16:31:58.800261 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bf7a805-2396-4311-a30c-caf06a35a26f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:31:58.801623 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bf7a805-2396-4311-a30c-caf06a35a26f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 810 time: 0.0952497 Sep 16 16:31:58.816369 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-08a661fc-a03b-42eb-b825-a56decb37f95 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/quotas/36186b0d094344dbb7b6d93645ae77e1 HTTP/1.1" status: 200 len: 375 time: 0.0085835 Sep 16 16:31:58.870799 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-57a396b0-3546-4fe2-8649-6142482f06f3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0494909 Sep 16 16:31:59.006142 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-70f8c7b7-a8ed-4786-99d7-8f5eb39136eb service neutron] 10.222.0.59 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240821 Sep 16 16:31:59.093945 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-ba7117c5-67f3-42f1-9685-43b644cdbd4d service neutron] 10.222.0.59 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811808 Sep 16 16:32:00.263518 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4e453b32-ab47-4ebe-b7db-1e83284c3754 req-310bfe8d-f644-427c-a4e5-678f4009b27e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 210 time: 0.0254965 Sep 16 16:32:01.338005 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-62cb9eee-7e65-4bf4-a27f-849f8f4bd4a8 req-524511c7-6e9f-4d86-b3c8-3d329f6c124d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 210 time: 0.0255754 Sep 16 16:32:02.416544 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-3a18807f-2b45-4655-bd33-9bd0890c70bb req-d664fabf-fdd7-4a37-ae71-66cdb1fbd695 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 210 time: 0.0271468 Sep 16 16:32:03.491731 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cae93142-d978-4ebe-8238-f3f3d7664855 req-b40d0f9f-042d-4177-8f32-c375d8cfe40e tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 210 time: 0.0257320 Sep 16 16:32:04.581141 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b671fb48-307b-4bb8-9c53-68ca2d1449bb req-a910c329-e8e3-4349-b29a-83e74e0c917f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 210 time: 0.0259333 Sep 16 16:32:05.271779 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-6a2dbe26-5365-4624-b63f-6e780c93e69b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:05.273229 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-6a2dbe26-5365-4624-b63f-6e780c93e69b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 810 time: 0.1108325 Sep 16 16:32:05.318312 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-314c03a7-b936-462c-b238-3d1af26c6ab7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=36186b0d094344dbb7b6d93645ae77e1 HTTP/1.1" status: 200 len: 380 time: 0.0338941 Sep 16 16:32:05.327901 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'port': {'device_id': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'admin_state_up': True, 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'security_groups': ['a157f8a5-ad80-4bf2-a667-a317c3bce936']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:32:05.432683 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Made reservation on behalf of 36186b0d094344dbb7b6d93645ae77e1 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:32:05.436072 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:05.553397 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Allocated IP 172.20.0.13 (baca97e8-c07b-484a-a0fa-c440a2abcfed/94ba1df5-707c-4998-b69b-115427a08b60/f60b2ea6-5112-49ec-87ef-8a99c6c62327) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:32:05.684237 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b675d317-e609-406c-b256-3b1a11e8b2d8 req-23ae29ed-83ac-44b1-b443-ea8f7e8fa974 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 210 time: 0.0381217 Sep 16 16:32:05.709400 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:05.742043 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:05.783990 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Network baca97e8-c07b-484a-a0fa-c440a2abcfed is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:32:05.787009 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:32:05.790551 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:32:05.817487 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event updated for resources: {'Port': ['ID=f60b2ea6-5112-49ec-87ef-8a99c6c62327,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:32:05.846618 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:05.847275 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:05.863333 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-4bfe0071-59bb-4224-b4d9-21589cc4f80b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5388892 Sep 16 16:32:05.876571 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Request body: {'port': {'device_id': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:32:05.931478 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.020131 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-8e049de3-7e17-42f1-a356-f4a71e5f17f3 None None] Provisioning complete for port f60b2ea6-5112-49ec-87ef-8a99c6c62327 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:32:06.020696 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8e049de3-7e17-42f1-a356-f4a71e5f17f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.052747 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-8e049de3-7e17-42f1-a356-f4a71e5f17f3 None None] Port f60b2ea6-5112-49ec-87ef-8a99c6c62327 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:32:06.183314 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f60b2ea6-5112-49ec-87ef-8a99c6c62327 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:32:06.190416 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.202347 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Transition to ACTIVE for port object f60b2ea6-5112-49ec-87ef-8a99c6c62327 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:32:06.206044 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.269265 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Pushing event updated for resources: {'Port': ['ID=f60b2ea6-5112-49ec-87ef-8a99c6c62327,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:32:06.320927 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Attempting to bind port f60b2ea6-5112-49ec-87ef-8a99c6c62327 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:32:06.321603 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Attempting to bind port f60b2ea6-5112-49ec-87ef-8a99c6c62327 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:32:06.321603 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Attempting to bind port f60b2ea6-5112-49ec-87ef-8a99c6c62327 on network baca97e8-c07b-484a-a0fa-c440a2abcfed {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:32:06.326569 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Port f60b2ea6-5112-49ec-87ef-8a99c6c62327 on network baca97e8-c07b-484a-a0fa-c440a2abcfed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:32:06.326888 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Attempting to bind port f60b2ea6-5112-49ec-87ef-8a99c6c62327 on network baca97e8-c07b-484a-a0fa-c440a2abcfed {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:32:06.331852 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 31, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:32:06.332186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Checking segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:32:06.332561 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Bound using segment: {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:32:06.332988 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Bound port: f60b2ea6-5112-49ec-87ef-8a99c6c62327, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc28b78f-3dff-4b2d-a033-1d9b94c43842', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 737, 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:32:06.333339 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.402513 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] For port f60b2ea6-5112-49ec-87ef-8a99c6c62327, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:32:06.406302 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] For port f60b2ea6-5112-49ec-87ef-8a99c6c62327, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:32:06.412627 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.448423 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:06.449030 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:06.450420 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] 10.222.0.66 "PUT /v2.0/ports/f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 1094 time: 0.5780823 Sep 16 16:32:06.450864 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:32:06.453118 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd4937a1-f99e-4347-94e7-43d313b8546d" -d '{"events": [{"name": "network-changed", "server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:32:06.508846 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4d8295-3efb-4748-afed-cb7c02d8be2e service neutron] Pushing event updated for resources: {'Port': ['ID=f60b2ea6-5112-49ec-87ef-8a99c6c62327,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:32:06.525205 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:32:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bc7ca35-eff5-408c-9e6a-46e6089da766 x-openstack-request-id: req-4bc7ca35-eff5-408c-9e6a-46e6089da766 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:32:06.525501 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:32:06.525755 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-4bc7ca35-eff5-408c-9e6a-46e6089da766 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:32:06.526152 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'status': 'completed', 'code': 200} Sep 16 16:32:06.541623 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-a6efc188-98ae-46e2-ae39-d5cf2f631c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:06.543130 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-a6efc188-98ae-46e2-ae39-d5cf2f631c6a service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1097 time: 0.0476272 Sep 16 16:32:06.589539 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-f71d57d8-824d-4172-960d-5864eb6ee705 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 217 time: 0.0389295 Sep 16 16:32:06.639319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-d0a754ba-6c0a-4ffc-a8f8-3a5f7c7e390c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:06.640782 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-d0a754ba-6c0a-4ffc-a8f8-3a5f7c7e390c service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0446868 Sep 16 16:32:06.690820 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-784a1032-f054-4860-978e-42f33d366fba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:06.692324 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-784a1032-f054-4860-978e-42f33d366fba service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0445893 Sep 16 16:32:06.820007 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-9503d738-2136-42f6-9ed6-9b1994f16005 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193836 Sep 16 16:32:06.827970 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e11e57-0f99-43a8-8e42-10fee976cd8b req-3f1ee6a9-da58-49ae-8863-5fe1302574e9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:06.829322 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-25e11e57-0f99-43a8-8e42-10fee976cd8b req-3f1ee6a9-da58-49ae-8863-5fe1302574e9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 944 time: 0.0710354 Sep 16 16:32:06.914852 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-25e11e57-0f99-43a8-8e42-10fee976cd8b req-e21f12c8-3d06-4423-a868-0ab53141e019 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779352 Sep 16 16:32:06.937210 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3e408dd3-609b-49fd-b780-b4d504adefb0 req-f50a0d4d-8a62-498e-93ce-3eb4ace4cf5a service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1070025 Sep 16 16:32:07.018479 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-8e2c8a3a-ebf4-4cfd-9a42-e5253ab147db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:07.019870 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-8e2c8a3a-ebf4-4cfd-9a42-e5253ab147db service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1097 time: 0.0389624 Sep 16 16:32:07.110939 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-11af93b0-548b-4863-925e-021505c1ea8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:07.112437 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-11af93b0-548b-4863-925e-021505c1ea8a service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0842030 Sep 16 16:32:07.156646 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-100843d9-d7a1-4039-8cb8-d9fe0204218f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 217 time: 0.0361803 Sep 16 16:32:07.205531 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-2844bea1-d3df-4495-a025-ae4a2a1101d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:07.206963 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-2844bea1-d3df-4495-a025-ae4a2a1101d6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0429804 Sep 16 16:32:07.253241 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-7e4da33e-7c04-4418-975d-e57fe56be6d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:07.254708 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-7e4da33e-7c04-4418-975d-e57fe56be6d5 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0398691 Sep 16 16:32:07.596310 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-152b6713-8ff3-4d62-bca8-b044b47e7869 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3333838 Sep 16 16:32:07.684403 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cd4937a1-f99e-4347-94e7-43d313b8546d req-36ea9515-72b3-405e-9f82-a5dca1948dad service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802164 Sep 16 16:32:08.031447 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfaa49f6-9809-4f99-aae6-232f4cd15f68 req-cf85c971-b661-4725-9f70-146cbf688d90 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:08.032928 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bfaa49f6-9809-4f99-aae6-232f4cd15f68 req-cf85c971-b661-4725-9f70-146cbf688d90 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 944 time: 0.0511832 Sep 16 16:32:08.069006 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-bfaa49f6-9809-4f99-aae6-232f4cd15f68 req-7a8283d5-e451-4e2b-a35c-9267089cf87d tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302303 Sep 16 16:32:08.499146 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device f60b2ea6-5112-49ec-87ef-8a99c6c62327 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:32:08.589490 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port f60b2ea6-5112-49ec-87ef-8a99c6c62327, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:32:08.599937 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'port_id': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'mac_address': 'fa:16:3e:fa:b7:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 737, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:32:08.638101 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:08.649837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f60b2ea6-5112-49ec-87ef-8a99c6c62327 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:32:08.671975 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port f60b2ea6-5112-49ec-87ef-8a99c6c62327, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:32:08.675416 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:08.721425 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=f60b2ea6-5112-49ec-87ef-8a99c6c62327,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:32:08.728219 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.728593 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.728939 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.729274 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.729606 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.729933 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.730259 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.730583 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.730925 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.731278 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.731603 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.731922 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:32:08.939175 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['f60b2ea6-5112-49ec-87ef-8a99c6c62327'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:32:09.183644 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bbf382-0581-4958-b9f7-5f4e226c8843 req-9f29b83c-a3cc-42c8-a26b-0cefb7f0d0d3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:09.185091 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22bbf382-0581-4958-b9f7-5f4e226c8843 req-9f29b83c-a3cc-42c8-a26b-0cefb7f0d0d3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 945 time: 0.0511637 Sep 16 16:32:09.220959 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22bbf382-0581-4958-b9f7-5f4e226c8843 req-70d3e0ca-0998-4536-887d-6701c54d658b tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300994 Sep 16 16:32:10.334860 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efda7bc-0415-4bd4-914b-fb48f1693fb3 req-18346662-383f-4b7b-b15d-58ee3ee1a2ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:10.336342 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4efda7bc-0415-4bd4-914b-fb48f1693fb3 req-18346662-383f-4b7b-b15d-58ee3ee1a2ca tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 945 time: 0.0507133 Sep 16 16:32:10.372094 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4efda7bc-0415-4bd4-914b-fb48f1693fb3 req-71c59d81-9abc-4b8b-a475-9e0b4a478ff7 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300784 Sep 16 16:32:10.514379 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device f60b2ea6-5112-49ec-87ef-8a99c6c62327 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:32:10.560860 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port f60b2ea6-5112-49ec-87ef-8a99c6c62327 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:32:10.564585 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port f60b2ea6-5112-49ec-87ef-8a99c6c62327 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:32:10.564961 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:10.637476 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:10.661541 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:32:10.663794 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0cd4b94e-a80b-42df-bd54-e10f7c0b89dd" -d '{"events": [{"server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "name": "network-vif-plugged", "status": "completed", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:32:10.676157 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port f60b2ea6-5112-49ec-87ef-8a99c6c62327, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:32:10.680395 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:10.726811 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=f60b2ea6-5112-49ec-87ef-8a99c6c62327,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:32:10.755878 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:32:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b20544d0-24b9-4487-9f2a-81f6e8f3dabf x-openstack-request-id: req-b20544d0-24b9-4487-9f2a-81f6e8f3dabf {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:32:10.756169 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "name": "network-vif-plugged", "status": "completed", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:32:10.756422 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-b20544d0-24b9-4487-9f2a-81f6e8f3dabf {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:32:10.756821 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'code': 200} Sep 16 16:32:10.911465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1de7b66a-38ef-4633-b082-6ee605adc47e req-bd14b41e-323c-4a54-9c1d-a2fefdc6a063 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:10.912815 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1de7b66a-38ef-4633-b082-6ee605adc47e req-bd14b41e-323c-4a54-9c1d-a2fefdc6a063 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1099 time: 0.0387838 Sep 16 16:32:10.947651 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1de7b66a-38ef-4633-b082-6ee605adc47e req-480043d1-f107-4ed7-9ee1-26c0f3e2b36d service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0263708 Sep 16 16:32:11.485706 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a1ce9f-745e-46a7-a839-444cee734aa0 req-3b5c78dc-3399-4d02-8581-aaf622bacc85 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:11.487057 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-93a1ce9f-745e-46a7-a839-444cee734aa0 req-3b5c78dc-3399-4d02-8581-aaf622bacc85 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 946 time: 0.0464678 Sep 16 16:32:11.522891 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-93a1ce9f-745e-46a7-a839-444cee734aa0 req-2ef07bb7-bee6-4801-971b-8cd0ef59ac47 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299199 Sep 16 16:32:12.635868 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dba7f2e-60db-492b-9bab-d323129ebbe1 req-5bed4585-b08a-43f9-9271-2e6ad7f736db tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:12.637388 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3dba7f2e-60db-492b-9bab-d323129ebbe1 req-5bed4585-b08a-43f9-9271-2e6ad7f736db tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 946 time: 0.0470850 Sep 16 16:32:12.675375 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3dba7f2e-60db-492b-9bab-d323129ebbe1 req-4422036c-6c66-4738-9415-3b8b4115ae45 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322506 Sep 16 16:32:12.783277 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4722f658-ded8-4fa9-805f-da7520b670d8 req-8e64b6ea-351f-4587-89ef-b350a2945fe4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:12.784752 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4722f658-ded8-4fa9-805f-da7520b670d8 req-8e64b6ea-351f-4587-89ef-b350a2945fe4 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 946 time: 0.0469263 Sep 16 16:32:12.794401 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 43844) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:32:12.798811 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Request body: {'floatingip': {'port_id': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:32:12.839978 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:13.403255 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:13.406765 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:13.500519 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Floating IP 5144330e-4db3-4e6e-8c1a-54a7e4e87b4b associated. External IP: 172.27.3.106, port: f60b2ea6-5112-49ec-87ef-8a99c6c62327. Sep 16 16:32:13.697443 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Router da1aab41-d805-4a4f-a252-59e579ace211 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:32:14.016867 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:32:14.021655 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:14.026638 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:32:14.041889 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:32:14.042675 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:32:14.043371 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:31:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:32:14.051296 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-2050425b-364a-4ddb-a00f-34165764f940 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "PUT /v2.0/floatingips/5144330e-4db3-4e6e-8c1a-54a7e4e87b4b HTTP/1.1" status: 200 len: 992 time: 1.2533157 Sep 16 16:32:14.051296 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:32:14.052985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89644711-5db5-431d-a81d-6ceaec3f032b" -d '{"events": [{"name": "network-changed", "server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:32:14.152776 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:32:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67ab9407-a45e-4189-84dd-ed04adae59af x-openstack-request-id: req-67ab9407-a45e-4189-84dd-ed04adae59af {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:32:14.153059 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:32:14.153305 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-67ab9407-a45e-4189-84dd-ed04adae59af {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:32:14.153646 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:32:14.153761 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'status': 'completed', 'code': 200} Sep 16 16:32:14.217243 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89644711-5db5-431d-a81d-6ceaec3f032b req-cad4542f-6200-4e24-8e57-b13632338586 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:14.218727 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-cad4542f-6200-4e24-8e57-b13632338586 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1099 time: 0.0443718 Sep 16 16:32:14.306561 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89644711-5db5-431d-a81d-6ceaec3f032b req-074a61e9-5fce-48be-9ad0-bc4ce349cb37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:14.308057 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-074a61e9-5fce-48be-9ad0-bc4ce349cb37 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0823319 Sep 16 16:32:14.366912 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '5144330e-4db3-4e6e-8c1a-54a7e4e87b4b', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'floating_ip_address': '172.27.3.106', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'port_id': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 596, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'mac_address': 'fa:16:3e:fa:b7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:31:58Z', 'updated_at': '2021-09-16T16:32:13Z', 'revision_number': 1, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:32:14.373559 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-e13b1181-b4a1-47c4-863b-ccc005d9cc63 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 1000 time: 0.0588942 Sep 16 16:32:14.395769 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:32:14.404324 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:32:14.404918 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:31:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:32:14.420977 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89644711-5db5-431d-a81d-6ceaec3f032b req-811aa5d0-2acc-4eec-a061-3c803c2a82f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:14.422410 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-811aa5d0-2acc-4eec-a061-3c803c2a82f6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0421042 Sep 16 16:32:14.466609 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89644711-5db5-431d-a81d-6ceaec3f032b req-f2c4c544-23fb-4f8b-b515-96bd8b76aa28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:32:14.468022 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-f2c4c544-23fb-4f8b-b515-96bd8b76aa28 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0388515 Sep 16 16:32:14.479095 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-23591173-3037-4823-bbe2-b7e7a0c45afc service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:32:14.480049 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-23591173-3037-4823-bbe2-b7e7a0c45afc service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0049050 Sep 16 16:32:14.505038 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:32:14.570606 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-e46e73bc-ac17-4a13-ba3a-a1d5888a648d service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834346 Sep 16 16:32:14.700675 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-89644711-5db5-431d-a81d-6ceaec3f032b req-c91a96ae-73f4-48d9-bc64-89ab7653ec2a service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1224051 Sep 16 16:32:14.724047 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '5144330e-4db3-4e6e-8c1a-54a7e4e87b4b', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'floating_ip_address': '172.27.3.106', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'port_id': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 596, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'mac_address': 'fa:16:3e:fa:b7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:31:58Z', 'updated_at': '2021-09-16T16:32:13Z', 'revision_number': 1, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:32:14.753812 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f164fe36-24eb-41eb-a912-4e96c5ec3f22 None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '5144330e-4db3-4e6e-8c1a-54a7e4e87b4b', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'floating_ip_address': '172.27.3.106', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'port_id': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 596, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'mac_address': 'fa:16:3e:fa:b7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:31:58Z', 'updated_at': '2021-09-16T16:32:13Z', 'revision_number': 1, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:32:14.922007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b8b634c-2b08-4af1-8105-4002220874e2 None None] New status for floating IP 5144330e-4db3-4e6e-8c1a-54a7e4e87b4b: ACTIVE {{(pid=93952) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:32:15.769748 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:20.729722 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-72716d2c-2e5a-4c81-ac79-f628028785d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:23.440834 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9d7361d4-5527-4b01-95b4-ece230496441 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:23.735242 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:24.399055 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:26.210394 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:45.775920 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:50.734146 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1f36777e-273a-41c0-9cc5-bbca970d1078 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:51.040089 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:32:53.441101 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6e9be777-ba7d-4673-8518-5d4135cb05d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:53.738387 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:54.401879 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:32:56.212647 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:15.790879 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:20.733850 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-63ea1747-2c49-4e23-859e-5517c9811f5f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:23.442412 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-091ce569-c3ad-41a8-bea3-e33d948e8ca2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:23.739342 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:24.017510 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3ea5e36e-3e99-4457-b09a-e18a98e01200 req-2acc8808-5d9e-4fdb-a2e6-ab17ee2e6b1e service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0299177 Sep 16 16:33:24.084666 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3ea5e36e-3e99-4457-b09a-e18a98e01200 req-c28ac7f7-0cc4-4785-a64c-35b73916a801 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0239327 Sep 16 16:33:24.125574 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3ea5e36e-3e99-4457-b09a-e18a98e01200 req-05f65c19-4b28-49d4-b9f3-6403d0e23291 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0194683 Sep 16 16:33:24.219578 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea5e36e-3e99-4457-b09a-e18a98e01200 req-e1962a86-1723-434b-a74d-309738ef11b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:33:24.221041 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3ea5e36e-3e99-4457-b09a-e18a98e01200 req-e1962a86-1723-434b-a74d-309738ef11b0 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0880749 Sep 16 16:33:24.405391 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:26.220658 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:28.040072 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:33:45.803757 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:50.733505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f59aa8de-9401-442f-825f-b61060a3d0a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:53.442786 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-25ec2586-c522-496b-aaa3-2b2b3a2d78f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:53.739723 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:54.407878 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:33:56.218137 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:05.037988 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:34:15.805138 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:20.732681 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-764581d6-2c08-4043-a3cf-6a19f381a3fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:23.442872 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ee0be627-b702-43fd-9105-6b0d13cf6522 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:23.738896 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:24.409344 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:25.017211 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-98840099-aa7f-4f31-9e6b-afa2138cd78a service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0387788 Sep 16 16:34:25.082228 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-873b7a83-9262-4f28-a9a0-7d4ab85bf819 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:34:25.083708 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-873b7a83-9262-4f28-a9a0-7d4ab85bf819 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1099 time: 0.0456934 Sep 16 16:34:25.184898 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-05cbc28b-4a0c-40a0-b2d5-6cc00a2dd952 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:34:25.186295 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-05cbc28b-4a0c-40a0-b2d5-6cc00a2dd952 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0835779 Sep 16 16:34:25.249222 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-4e0f6709-a493-4354-9352-04a15aecc3f6 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 1002 time: 0.0560110 Sep 16 16:34:25.296129 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-ff642a95-77a3-416d-805a-a71fd67dff01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:34:25.297425 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-ff642a95-77a3-416d-805a-a71fd67dff01 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0420280 Sep 16 16:34:25.345448 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-fdb0ae59-7a0f-4d5b-8f46-e239861e08af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:34:25.346888 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-fdb0ae59-7a0f-4d5b-8f46-e239861e08af service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0416431 Sep 16 16:34:25.436189 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-f733a1ad-2946-4c5a-8c62-9aa51859f106 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817068 Sep 16 16:34:25.528114 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ba4abd7f-189c-490b-b411-add8d3db0456 req-f934475e-ef26-4e2d-afe3-162378b07909 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853229 Sep 16 16:34:26.220573 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:42.035941 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:34:45.818941 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:50.732137 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d4452bf-80cc-4b89-a1f6-3437c4ef7272 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:53.442780 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-30cf57ad-68f1-42d4-8085-a9a13c99af63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:53.739444 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:54.413127 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:34:56.225315 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:15.805224 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:19.034390 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:35:20.732102 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0745406c-84bb-4aa5-b725-e6370ddee6e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:23.442760 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-74496136-16c3-4334-99ea-f615aa0911a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:23.739633 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:24.414691 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:26.225352 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:27.059834 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a087a129-4545-4776-b2f6-861ccca0a7bd req-82b31ade-d96a-4736-bb80-267fca55d0d2 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0266557 Sep 16 16:35:27.123403 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a087a129-4545-4776-b2f6-861ccca0a7bd req-69e8b851-2a43-4900-a147-f889f088ce25 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0242605 Sep 16 16:35:27.159936 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a087a129-4545-4776-b2f6-861ccca0a7bd req-85e33d84-14c9-472b-8d56-f2a28e64b30e service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0187397 Sep 16 16:35:27.254211 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a087a129-4545-4776-b2f6-861ccca0a7bd req-4667d217-83cc-4b34-9bfe-8c8824cb9def service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:35:27.255960 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a087a129-4545-4776-b2f6-861ccca0a7bd req-4667d217-83cc-4b34-9bfe-8c8824cb9def service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0894282 Sep 16 16:35:45.819843 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:50.731929 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b2ecba18-ca92-4e50-a1bc-21ea746b8096 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:53.443127 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e100f320-98df-4bee-b647-eb040a7bdd05 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:53.739121 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:54.417662 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:35:56.032741 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:35:56.227772 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:15.820455 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:20.731715 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-39ad6487-1f2a-4d8d-b594-c89dcf25da1c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:23.444589 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a8fdd56e-5dfb-4d69-9d79-f91e2b2840bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:23.740572 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:24.419959 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:26.231973 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:27.046074 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-741c1d8f-74b1-453f-a010-84a8dca0351a service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0382428 Sep 16 16:36:27.103132 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c148b04f-3030-4659-8532-fa48628e4266 req-01bb9205-bb17-4c0c-8b38-8bf166392111 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:36:27.104602 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-01bb9205-bb17-4c0c-8b38-8bf166392111 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1099 time: 0.0383027 Sep 16 16:36:27.218726 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c148b04f-3030-4659-8532-fa48628e4266 req-412a20fa-7e31-45ef-b8fc-a0a2fe022092 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:36:27.220215 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-412a20fa-7e31-45ef-b8fc-a0a2fe022092 service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0863044 Sep 16 16:36:27.282779 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-27f4ff0e-25e4-40bc-b3ed-810f851babe3 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 1002 time: 0.0549319 Sep 16 16:36:27.335103 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c148b04f-3030-4659-8532-fa48628e4266 req-c31e8b0c-edf3-43fb-86e2-ce70aada4315 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:36:27.336520 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-c31e8b0c-edf3-43fb-86e2-ce70aada4315 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0466745 Sep 16 16:36:27.379153 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c148b04f-3030-4659-8532-fa48628e4266 req-50f91318-5e9d-421f-b162-848aec23bf27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:36:27.380578 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-50f91318-5e9d-421f-b162-848aec23bf27 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0371139 Sep 16 16:36:27.469733 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-302fa219-b8f3-4422-9be3-d46516892902 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819829 Sep 16 16:36:27.564041 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c148b04f-3030-4659-8532-fa48628e4266 req-b1616de4-d8de-42bd-906c-b306eb967b71 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868406 Sep 16 16:36:33.031571 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:36:45.849957 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:50.732718 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-789dc192-41fb-4cbe-9485-873fddbc0009 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:53.445030 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b7be36f8-faef-4d7a-90bb-fcdfd4215440 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:53.740221 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:54.423048 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:36:56.237347 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:10.029155 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:37:15.880733 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:20.732774 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b433d68f-c9e6-4a7c-894b-441d939b4396 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:23.446135 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1262c4b1-4fd9-465f-8ca8-7f71698f7754 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:23.740599 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:24.424976 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:26.238504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:27.267976 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-84014691-b89d-4304-a85a-7d5325fe8677 req-ad551261-2a82-4e8d-9f99-6e5142a0480c service neutron] (93950) timed out ('10.222.0.66', 56951) {{(pid=93950) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 16 16:37:28.102115 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6c9701b3-4d29-4e76-9ed4-0524cf8aacdc req-772f5a69-227c-442c-beb1-8f16c47d7ab7 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1317880 Sep 16 16:37:28.167165 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6c9701b3-4d29-4e76-9ed4-0524cf8aacdc req-b374d0c3-6290-4d1f-8512-f7038329ae12 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0241351 Sep 16 16:37:28.208870 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6c9701b3-4d29-4e76-9ed4-0524cf8aacdc req-5493eadc-dbfb-4dfa-ade3-ec342ec0c7b7 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0221615 Sep 16 16:37:28.299444 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9701b3-4d29-4e76-9ed4-0524cf8aacdc req-6589f2e2-5abf-4457-b036-a1c78c82b6e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:37:28.300800 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6c9701b3-4d29-4e76-9ed4-0524cf8aacdc req-6589f2e2-5abf-4457-b036-a1c78c82b6e1 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0851181 Sep 16 16:37:28.858521 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-96ad44d5-24cc-40df-b972-2a0807e8b496 req-00a0cbd2-dcf8-4662-9119-a2e2d7a03f62 service neutron] (93950) timed out ('10.222.0.66', 56945) {{(pid=93950) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 16 16:37:45.883001 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:47.028218 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:37:50.732844 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-851a30e5-ccbe-4867-b4ae-8007be5cd3c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:53.446806 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8b4fe280-17ab-412f-b38f-dbd5f3976382 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:53.740157 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:54.427567 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:37:56.239745 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:15.897113 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:20.733775 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-13336379-7e32-4825-b6ab-7b8fb9516c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:23.454047 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-003c135d-916f-4f5a-a0c1-c0f0035bac53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:23.740712 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:24.026640 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:38:24.429530 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:26.275722 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:30.020784 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-065666d1-9a01-4ef7-8aec-d9048c7d1ada service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0402012 Sep 16 16:38:30.098044 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-4749e57e-a57c-48c9-b2fd-f78b525aaacf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:30.099427 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-4749e57e-a57c-48c9-b2fd-f78b525aaacf service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=36186b0d094344dbb7b6d93645ae77e1&device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 1099 time: 0.0437229 Sep 16 16:38:30.203192 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-60c92e3b-11e1-4209-9262-4ada44a2b7af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:30.204705 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-60c92e3b-11e1-4209-9262-4ada44a2b7af service neutron] 10.222.0.66 "GET /v2.0/networks?id=baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 200 len: 911 time: 0.0839860 Sep 16 16:38:30.275578 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-66313bd0-8081-4b0a-aa0c-e93037fb0d71 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 200 len: 1002 time: 0.0595477 Sep 16 16:38:30.324727 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-6e6b20b4-70bf-49b1-9837-84a0d42b8e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:30.326169 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-6e6b20b4-70bf-49b1-9837-84a0d42b8e46 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 200 len: 849 time: 0.0422382 Sep 16 16:38:30.374255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-5e5a9a70-dfdf-4d7b-a3ad-18d128a3e89c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:30.375677 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-5e5a9a70-dfdf-4d7b-a3ad-18d128a3e89c service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=baca97e8-c07b-484a-a0fa-c440a2abcfed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0393381 Sep 16 16:38:30.474010 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-7aea61e2-05ea-4d9f-adcf-6fa63626b31c service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851068 Sep 16 16:38:30.563530 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dfd67e71-7353-4045-b9b2-89277ec26fb9 req-b0199fce-67da-4c87-a1ee-599465bad840 service neutron] 10.222.0.66 "GET /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0790029 Sep 16 16:38:35.458750 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d286ae8a-5403-4b75-a820-5c68b6fb70ec req-5ba744b7-332c-4637-a8d7-c6e9f15c8d9f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:35.460201 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d286ae8a-5403-4b75-a820-5c68b6fb70ec req-5ba744b7-332c-4637-a8d7-c6e9f15c8d9f tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 946 time: 0.0515695 Sep 16 16:38:35.495906 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d286ae8a-5403-4b75-a820-5c68b6fb70ec req-c947c712-f33d-4fd2-a38f-bf6dd0c53a51 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298996 Sep 16 16:38:36.174817 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-1b906afd-7998-4c55-93d5-e7f3f0ff81f9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:36.176241 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-1b906afd-7998-4c55-93d5-e7f3f0ff81f9 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 946 time: 0.0469363 Sep 16 16:38:36.260617 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Deleting port f60b2ea6-5112-49ec-87ef-8a99c6c62327 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:38:36.260950 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:36.346572 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] For port f60b2ea6-5112-49ec-87ef-8a99c6c62327, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=f60b2ea6-5112-49ec-87ef-8a99c6c62327,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:38:36.346930 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:36.506789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:36.507500 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:36.507500 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.l3_db [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Floating IP 5144330e-4db3-4e6e-8c1a-54a7e4e87b4b disassociated. External IP: 172.27.3.106, port: f60b2ea6-5112-49ec-87ef-8a99c6c62327. Sep 16 16:38:36.507798 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Calling delete_port for f60b2ea6-5112-49ec-87ef-8a99c6c62327 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:38:36.612606 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-319580b9-296a-458d-8e35-7597704b56b5 req-a8f4a938-85bd-483f-bc57-584b8d9fb8c1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:38:36.614162 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-319580b9-296a-458d-8e35-7597704b56b5 req-a8f4a938-85bd-483f-bc57-584b8d9fb8c1 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/ports?device_id=3f919f3f-5c7c-4188-aae9-64ebf15d8bd5 HTTP/1.1" status: 200 len: 946 time: 0.0508356 Sep 16 16:38:36.634237 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:36.652391 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-319580b9-296a-458d-8e35-7597704b56b5 req-14fe8d0b-59dd-4974-9bd0-7e01496d8871 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups?id=a157f8a5-ad80-4bf2-a667-a317c3bce936&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319936 Sep 16 16:38:36.662291 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event deleted for resources: {'Port': ['ID=f60b2ea6-5112-49ec-87ef-8a99c6c62327,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:36.671835 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.672179 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.672520 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.672851 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.673770 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.674101 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.674424 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.674748 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.675071 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.675419 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.675738 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.676142 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:36.784385 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Router da1aab41-d805-4a4f-a252-59e579ace211 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:38:36.885713 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:38:36.895041 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:38:36.904269 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:38:36.904945 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:38:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:36.924910 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] No DVR routers for this DVR port f60b2ea6-5112-49ec-87ef-8a99c6c62327 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:38:36.927385 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:36.929474 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b4660236-b21c-468c-9008-e51b09d0b0d5 req-d562592d-e574-4172-b171-c64732a84fb6 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.66 "DELETE /v2.0/ports/f60b2ea6-5112-49ec-87ef-8a99c6c62327 HTTP/1.1" status: 204 len: 173 time: 0.7467549 Sep 16 16:38:36.929913 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'name': 'network-vif-deleted', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:38:36.932481 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d565748c-045e-47cd-9ae7-e33d9dc7fb94" -d '{"events": [{"server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "name": "network-vif-deleted", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:38:37.016016 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:38:37.025823 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:38:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb045b74-da8f-42ca-a4b8-bef1c75371a3 x-openstack-request-id: req-eb045b74-da8f-42ca-a4b8-bef1c75371a3 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:38:37.026221 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3f919f3f-5c7c-4188-aae9-64ebf15d8bd5", "name": "network-vif-deleted", "tag": "f60b2ea6-5112-49ec-87ef-8a99c6c62327", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:38:37.026574 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-eb045b74-da8f-42ca-a4b8-bef1c75371a3 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:38:37.027064 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f919f3f-5c7c-4188-aae9-64ebf15d8bd5', 'name': 'network-vif-deleted', 'tag': 'f60b2ea6-5112-49ec-87ef-8a99c6c62327', 'status': 'completed', 'code': 200} Sep 16 16:38:37.221778 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:37.246603 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:38:37.254523 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:38:37.255056 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:38:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:37.362089 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:38:37.555790 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:37.585327 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4b5d57-e56e-4977-8501-6460ee4038ac None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:22:11Z', 'revision_number': 4, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '21f70636-78ad-426a-af75-45688a14aabf', 'name': '', 'network_id': 'baca97e8-c07b-484a-a0fa-c440a2abcfed', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'mac_address': 'fa:16:3e:a4:c4:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '94ba1df5-707c-4998-b69b-115427a08b60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:10Z', 'updated_at': '2021-09-16T16:22:20Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'subnets': [{'id': '94ba1df5-707c-4998-b69b-115427a08b60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:38:37.742542 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 44742) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:37.784594 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-976fc1d4-7c71-450a-8bda-8414763ec2be None None] New status for floating IP 5144330e-4db3-4e6e-8c1a-54a7e4e87b4b: DOWN {{(pid=93952) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:38:37.801916 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:37.825558 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:37.878106 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:37.880610 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:37.881768 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "DELETE /v2.0/security-groups/a157f8a5-ad80-4bf2-a667-a317c3bce936 HTTP/1.1" status: 204 len: 168 time: 0.1381452 Sep 16 16:38:37.887232 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44744) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:37.890785 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a157f8a5-ad80-4bf2-a667-a317c3bce936,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:37.899681 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.899990 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.900332 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.900661 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.900914 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.api.v2.resource [None req-cc730086-650b-46f2-86b3-087bf1025d20 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] show failed (client error): The resource could not be found. Sep 16 16:38:37.901039 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.901298 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.904764 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.904922 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-cc730086-650b-46f2-86b3-087bf1025d20 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "GET /v2.0/security-groups/a157f8a5-ad80-4bf2-a667-a317c3bce936 HTTP/1.1" status: 404 len: 347 time: 0.0163009 Sep 16 16:38:37.905027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.905027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.905027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.905027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.905027 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8efd56ad-25e0-4e8b-a1cf-d643be137ad3 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:38:37.905437 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44746) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:38.030037 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Deleting port 16cb3c88-e60f-4467-b39d-840f94bd2dce {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:38:38.030495 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:38.105117 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:38.105441 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:38.117462 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Calling delete_port for 16cb3c88-e60f-4467-b39d-840f94bd2dce owned by network:floatingip {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:38:38.253296 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:38.277279 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Pushing event deleted for resources: {'Port': ['ID=16cb3c88-e60f-4467-b39d-840f94bd2dce,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:38.338367 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks [] for floatingip, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:38.340851 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:38.341980 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-978a56eb-d52f-48fc-94c4-bf5450ab8304 tempest-AttachVolumeTestJSON-2014128877 tempest-AttachVolumeTestJSON-2014128877-project] 10.222.0.59 "DELETE /v2.0/floatingips/5144330e-4db3-4e6e-8c1a-54a7e4e87b4b HTTP/1.1" status: 204 len: 168 time: 0.4362452 Sep 16 16:38:40.258386 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device f60b2ea6-5112-49ec-87ef-8a99c6c62327 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:38:40.277687 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: f60b2ea6-5112-49ec-87ef-8a99c6c62327 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:38:40.278019 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device f60b2ea6-5112-49ec-87ef-8a99c6c62327 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:38:41.889403 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44774) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:42.339379 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:42.811843 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Deleting port 21f70636-78ad-426a-af75-45688a14aabf {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:38:42.812178 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:42.889042 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] For port 21f70636-78ad-426a-af75-45688a14aabf, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=21f70636-78ad-426a-af75-45688a14aabf,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:38:42.889397 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:42.901601 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Calling delete_port for 21f70636-78ad-426a-af75-45688a14aabf owned by network:router_interface {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:38:43.069876 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:43.093121 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Pushing event deleted for resources: {'Port': ['ID=21f70636-78ad-426a-af75-45688a14aabf,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:43.257675 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:43.461983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Router da1aab41-d805-4a4f-a252-59e579ace211 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:38:43.567292 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:38:43.572671 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-eee6e0b3-5eac-4532-a604-0bc80a39afb3 admin admin] 10.222.0.59 "PUT /v2.0/routers/da1aab41-d805-4a4f-a252-59e579ace211/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6817656 Sep 16 16:38:43.574686 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44778) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:43.577187 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] Sync routers for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:38:43.586166 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:38:43.586763 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:38:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:43.675679 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks [] for router, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:43.689433 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:38:43.774734 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:43.826179 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Deleting port d94e6d19-6301-4628-a0ba-e2677178f7c9 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:38:43.826514 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:43.867733 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:38:43Z', 'revision_number': 5, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port': {'id': 'd94e6d19-6301-4628-a0ba-e2677178f7c9', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:f4:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:22:03Z', 'updated_at': '2021-09-16T16:22:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:43.895076 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] Checking router: da1aab41-d805-4a4f-a252-59e579ace211 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:38:43.903103 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] Routers {'da1aab41-d805-4a4f-a252-59e579ace211'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:38:43.903725 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:38:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['da1aab41-d805-4a4f-a252-59e579ace211'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:43.906777 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] For port d94e6d19-6301-4628-a0ba-e2677178f7c9, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d94e6d19-6301-4628-a0ba-e2677178f7c9,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:38:43.907322 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:43.919190 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Calling delete_port for d94e6d19-6301-4628-a0ba-e2677178f7c9 owned by network:router_gateway {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:38:43.992042 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] Set router da1aab41-d805-4a4f-a252-59e579ace211 gateway port host: None {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:38:44.045448 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:38:43Z', 'revision_number': 6, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:44.071021 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf3f4bf3-8a38-483c-909f-e5a7d8ca5d64 None None] The sync data for ids ['da1aab41-d805-4a4f-a252-59e579ace211'] in dv-cinder-805887-15-iscsi is: [{'id': 'da1aab41-d805-4a4f-a252-59e579ace211', 'name': 'tempest-AttachVolumeTestJSON-183716530-router', 'tenant_id': '36186b0d094344dbb7b6d93645ae77e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:22:02Z', 'updated_at': '2021-09-16T16:38:43Z', 'revision_number': 6, 'project_id': '36186b0d094344dbb7b6d93645ae77e1', 'gw_port_host': None}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:38:44.084094 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.110154 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=d94e6d19-6301-4628-a0ba-e2677178f7c9,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:44.168915 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.257475 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.259590 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.302927 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.303427 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router da1aab41-d805-4a4f-a252-59e579ace211 {{(pid=93951) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:38:44.308539 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.309680 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a4ea45a5-e7bf-4935-b914-1bb99697d3b2 admin admin] 10.222.0.59 "DELETE /v2.0/routers/da1aab41-d805-4a4f-a252-59e579ace211 HTTP/1.1" status: 204 len: 168 time: 0.7339413 Sep 16 16:38:44.312169 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44780) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:44.355987 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_v2 [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Deleting subnet 94ba1df5-707c-4998-b69b-115427a08b60 {{(pid=93951) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:38:44.358785 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.391190 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-58472601'] for subnet, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.477394 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.536532 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-58361729', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58434304'] for subnet, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.561360 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=94ba1df5-707c-4998-b69b-115427a08b60,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:44.565222 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.567901 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e4904a9a-a589-4564-82cd-40f1dfa29842 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/94ba1df5-707c-4998-b69b-115427a08b60 HTTP/1.1" status: 204 len: 168 time: 0.2539771 Sep 16 16:38:44.569479 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44782) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:44.572027 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bfe9efe-54ce-461e-9a02-d409092bf58b None None] Network baca97e8-c07b-484a-a0fa-c440a2abcfed requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:38:44.638930 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.690385 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Deleting port 716bea06-3227-4474-9309-79e02d67ed2d {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:38:44.690715 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.753934 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] For port 716bea06-3227-4474-9309-79e02d67ed2d, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=716bea06-3227-4474-9309-79e02d67ed2d,segment=NetworkSegment(bc28b78f-3dff-4b2d-a033-1d9b94c43842),segment_id=bc28b78f-3dff-4b2d-a033-1d9b94c43842)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:38:44.754238 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.766598 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Calling delete_port for 716bea06-3227-4474-9309-79e02d67ed2d owned by network:dhcp {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:38:44.812998 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 21f70636-78ad-426a-af75-45688a14aabf no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:38:44.833634 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 21f70636-78ad-426a-af75-45688a14aabf {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:38:44.834263 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 21f70636-78ad-426a-af75-45688a14aabf not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:38:44.857346 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.882733 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Pushing event deleted for resources: {'Port': ['ID=716bea06-3227-4474-9309-79e02d67ed2d,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:44.885990 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6378f993-bf08-49d5-ada8-0fa27ca7ac10 None None] DHCP port deletion for baca97e8-c07b-484a-a0fa-c440a2abcfed request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:38:44.888831 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] No DVR routers for this DVR port 716bea06-3227-4474-9309-79e02d67ed2d on host dv-cinder-805887-15-iscsi {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:38:44.966022 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:44.986410 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['baca97e8-c07b-484a-a0fa-c440a2abcfed']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:44.995501 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bc28b78f-3dff-4b2d-a033-1d9b94c43842') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:44.995803 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bc28b78f-3dff-4b2d-a033-1d9b94c43842') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:38:45.005335 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.018296 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.024639 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Releasing vlan 737 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:38:45.025105 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:38:45.026841 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:38:45.081145 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.086851 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.088563 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] 10.222.0.59 "DELETE /v2.0/networks/baca97e8-c07b-484a-a0fa-c440a2abcfed HTTP/1.1" status: 204 len: 168 time: 0.5181813 Sep 16 16:38:45.099570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e11a553a-f02c-43b6-81cb-9a8178219641 admin admin] Pushing event deleted for resources: {'Network': ['ID=baca97e8-c07b-484a-a0fa-c440a2abcfed,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:45.216255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44788) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:45.258600 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-c47c0a3b-937f-4602-93b6-0564a9ae8448 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=36186b0d094344dbb7b6d93645ae77e1&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0411696 Sep 16 16:38:45.260956 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44790) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:45.306953 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-35f51965-9c2e-48d0-a607-05299f144dfa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.326727 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-35f51965-9c2e-48d0-a607-05299f144dfa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.378561 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-35f51965-9c2e-48d0-a607-05299f144dfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.381106 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-35f51965-9c2e-48d0-a607-05299f144dfa admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:45.382218 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-35f51965-9c2e-48d0-a607-05299f144dfa admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1f97f76e-27ef-4732-9de2-80d44bd52032 HTTP/1.1" status: 204 len: 168 time: 0.1203847 Sep 16 16:38:45.389570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35f51965-9c2e-48d0-a607-05299f144dfa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f97f76e-27ef-4732-9de2-80d44bd52032,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:45.911728 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:46.169955 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d94e6d19-6301-4628-a0ba-e2677178f7c9 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:38:46.191730 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: d94e6d19-6301-4628-a0ba-e2677178f7c9 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:38:46.192077 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d94e6d19-6301-4628-a0ba-e2677178f7c9 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:38:46.192499 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 716bea06-3227-4474-9309-79e02d67ed2d no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:38:46.211238 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 716bea06-3227-4474-9309-79e02d67ed2d {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:38:46.211571 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 716bea06-3227-4474-9309-79e02d67ed2d not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:38:50.734384 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c81260d1-a39a-405d-885d-66a0600e615a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.042168 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44880) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:51.143936 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-20d33738-3322-433c-b880-e742f6c070f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.230205 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-20d33738-3322-433c-b880-e742f6c070f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.233668 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-20d33738-3322-433c-b880-e742f6c070f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.270520 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-20d33738-3322-433c-b880-e742f6c070f2 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=11d9821bba0c4dc7ac78eca946704cb5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2272999 Sep 16 16:38:51.271608 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20d33738-3322-433c-b880-e742f6c070f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b3a093e-942a-435d-a34c-0e0c19ae02b6,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:51.273284 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 44884) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:51.320928 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-eb6fc459-fe2d-4919-b5df-2a91cc9ab1c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.343367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-eb6fc459-fe2d-4919-b5df-2a91cc9ab1c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.387327 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-eb6fc459-fe2d-4919-b5df-2a91cc9ab1c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.389879 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-eb6fc459-fe2d-4919-b5df-2a91cc9ab1c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.391029 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-eb6fc459-fe2d-4919-b5df-2a91cc9ab1c4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/5b3a093e-942a-435d-a34c-0e0c19ae02b6 HTTP/1.1" status: 204 len: 168 time: 0.1167619 Sep 16 16:38:51.399327 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6fc459-fe2d-4919-b5df-2a91cc9ab1c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b3a093e-942a-435d-a34c-0e0c19ae02b6,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:51.641234 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44890) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:51.654709 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a244a8fb-5939-4896-a4e9-ab4aef8c8e12 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.741530 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a244a8fb-5939-4896-a4e9-ab4aef8c8e12 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.745128 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a244a8fb-5939-4896-a4e9-ab4aef8c8e12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.781684 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a244a8fb-5939-4896-a4e9-ab4aef8c8e12 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=54f7a181130d47708094a58aabe7f643&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1387584 Sep 16 16:38:51.783612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a244a8fb-5939-4896-a4e9-ab4aef8c8e12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f9089dd-a48a-4ee6-a568-dee320bc86ab,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:51.784351 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 44892) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:51.833895 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e60f9e3b-2016-425a-b327-0ecacbadd003 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.854647 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e60f9e3b-2016-425a-b327-0ecacbadd003 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.900590 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e60f9e3b-2016-425a-b327-0ecacbadd003 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.903281 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e60f9e3b-2016-425a-b327-0ecacbadd003 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:51.904426 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e60f9e3b-2016-425a-b327-0ecacbadd003 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/2f9089dd-a48a-4ee6-a568-dee320bc86ab HTTP/1.1" status: 204 len: 168 time: 0.1191056 Sep 16 16:38:51.912158 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60f9e3b-2016-425a-b327-0ecacbadd003 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f9089dd-a48a-4ee6-a568-dee320bc86ab,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:52.921091 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 44926) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:53.025918 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-57abae28-b777-43a2-b844-ca3d04f7104f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.115295 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-57abae28-b777-43a2-b844-ca3d04f7104f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.118849 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-57abae28-b777-43a2-b844-ca3d04f7104f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.156668 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-57abae28-b777-43a2-b844-ca3d04f7104f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=b10ee888a97a4183b66b24b31a70987f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2345240 Sep 16 16:38:53.158052 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57abae28-b777-43a2-b844-ca3d04f7104f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c5c1cb2-3c26-4bb8-b7c4-5cd6e0609857,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:53.159929 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 44930) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:38:53.206841 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5129c41f-f37a-42e7-823d-80cc60c7480f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.227989 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5129c41f-f37a-42e7-823d-80cc60c7480f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.271228 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5129c41f-f37a-42e7-823d-80cc60c7480f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.273761 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-5129c41f-f37a-42e7-823d-80cc60c7480f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.274884 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-5129c41f-f37a-42e7-823d-80cc60c7480f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0c5c1cb2-3c26-4bb8-b7c4-5cd6e0609857 HTTP/1.1" status: 204 len: 168 time: 0.1139114 Sep 16 16:38:53.283668 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5129c41f-f37a-42e7-823d-80cc60c7480f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c5c1cb2-3c26-4bb8-b7c4-5cd6e0609857,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:38:53.454841 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8f359b99-cb9e-46c0-a273-9a74fe38602b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:53.745734 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:54.436076 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:38:56.245183 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:01.030808 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:39:15.900867 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:20.735273 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e20ed688-c787-42e2-a992-bbf75031ca79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:20.778816 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45112) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:20.881330 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-52478c8b-816b-42c2-88c6-fe732124ed01 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:20.967065 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-52478c8b-816b-42c2-88c6-fe732124ed01 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:20.970438 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-52478c8b-816b-42c2-88c6-fe732124ed01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:21.007155 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-52478c8b-816b-42c2-88c6-fe732124ed01 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=165e372570b8477dbdb75d982d3aa49c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2272794 Sep 16 16:39:21.008278 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52478c8b-816b-42c2-88c6-fe732124ed01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be873fcb-bce5-4257-83f3-d2fd0e696c82,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:21.009885 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45116) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:21.057285 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fa7e4e89-2319-4391-9f65-740f4ac8e78c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:21.077336 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fa7e4e89-2319-4391-9f65-740f4ac8e78c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:21.124925 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fa7e4e89-2319-4391-9f65-740f4ac8e78c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:21.127523 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-fa7e4e89-2319-4391-9f65-740f4ac8e78c admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:21.129219 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-fa7e4e89-2319-4391-9f65-740f4ac8e78c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/be873fcb-bce5-4257-83f3-d2fd0e696c82 HTTP/1.1" status: 204 len: 168 time: 0.1176505 Sep 16 16:39:21.136377 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7e4e89-2319-4391-9f65-740f4ac8e78c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be873fcb-bce5-4257-83f3-d2fd0e696c82,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:23.445345 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a20cb581-c0ea-4111-9016-35b1fea808d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:23.743511 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:24.436905 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:26.247470 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:33.707620 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2b4fbff-0cd2-48f1-b873-8dc7020c715d req-b14a61be-286b-44ff-bbe0-0b93ed3190fe service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0240695 Sep 16 16:39:33.771715 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2b4fbff-0cd2-48f1-b873-8dc7020c715d req-e26a6ba4-f1db-4253-b481-16fa936395e6 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0235610 Sep 16 16:39:33.811819 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2b4fbff-0cd2-48f1-b873-8dc7020c715d req-2db117ee-a560-461c-8c8d-9229fdee24bc service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0195136 Sep 16 16:39:33.907977 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b4fbff-0cd2-48f1-b873-8dc7020c715d req-c5aa1c94-7b9d-4967-adb1-8141d69914cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:39:33.909424 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f2b4fbff-0cd2-48f1-b873-8dc7020c715d req-c5aa1c94-7b9d-4967-adb1-8141d69914cf service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0906250 Sep 16 16:39:38.028760 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:39:40.076938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45248) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:40.180577 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.268855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.275369 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.309915 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a48834f3-9ca7-4f74-9600-68ec2bbd9dea,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:40.314372 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=3adfcecfcab94fa085389a91b7b11822&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2364247 Sep 16 16:39:40.318030 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45252) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:40.320121 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.320475 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.320815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.321151 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.321483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.321812 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.322138 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.322467 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.322791 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.323113 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.323461 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.323777 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a5da81c-fce6-4836-8397-7f245767abe7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.365564 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.389494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.433546 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.436292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:40.437455 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a48834f3-9ca7-4f74-9600-68ec2bbd9dea HTTP/1.1" status: 204 len: 168 time: 0.1184406 Sep 16 16:39:40.446828 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a48834f3-9ca7-4f74-9600-68ec2bbd9dea,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:40.453702 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.454048 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.454387 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.454725 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.455058 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.455423 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.455754 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.456079 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.456405 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.457283 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.457606 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:40.457941 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c5c4dfe-7c46-439f-a904-7fbeae8159cb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:41.022744 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45274) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:41.114682 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-908423069-network', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:39:41.135933 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Made reservation on behalf of 8b9df3c8324941d482822ccfbb50493d for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:39:41.138064 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.146705 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.232916 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.236913 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.261999 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 747} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:39:41.271499 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b3f204f-d99f-476e-bd67-e9cfd4c76856,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:41.277454 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.277802 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Added segment 2065031c-0eec-4fd2-9ec0-667b568e60f5 of type vlan for network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 Sep 16 16:39:41.317054 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.341136 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.342172 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:39:41.342851 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.374766 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3509068 Sep 16 16:39:41.377772 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45278) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:41.383329 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Request body: {'subnet': {'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-908423069-subnet', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:39:41.404029 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Made reservation on behalf of 8b9df3c8324941d482822ccfbb50493d for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:39:41.405004 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14639c32-eac7-4cf8-a74b-349b47b8a2c7 admin admin] Pushing event updated for resources: {'Network': ['ID=5b1e1b97-8da3-4734-a096-dcc18d4c91f6,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:41.406538 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58434343'] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.414599 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:39:41.568536 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-58361794', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58434313'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.623612 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae0084a1-dbaa-404c-a430-61ff268bd88f,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:41.632570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Checking segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:41.632920 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Network hostable DHCP agents. Network: 5b1e1b97-8da3-4734-a096-dcc18d4c91f6, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:39:41.648288 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:39:41.656905 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, 5b1e1b97-8da3-4734-a096-dcc18d4c91f6) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:41.661673 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:39:41.662800 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.666056 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b27eed7-4412-4299-966d-d5e28e145b97 None None] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:39:41.677135 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-29989183-6855-444b-a91b-d99a2decab3d admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.2976840 Sep 16 16:39:41.679748 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45280) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:41.684246 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:39:41.703705 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.704674 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.765511 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.807861 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:39:41.808742 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.897310 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:41.941855 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Allocated IP 172.20.0.2 (5b1e1b97-8da3-4734-a096-dcc18d4c91f6/ae0084a1-dbaa-404c-a430-61ff268bd88f/491a1093-71aa-47a5-936a-f29926efe34c) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:39:42.083013 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.084960 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.088915 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.104730 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.126107 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:42.130183 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:42.136447 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:39:42.139381 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Pushing event updated for resources: {'Port': ['ID=491a1093-71aa-47a5-936a-f29926efe34c,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:42.149812 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.150222 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.150564 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.150928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.151365 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.151678 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.152059 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.152376 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.152815 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.153119 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.153407 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.153783 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:42.203464 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Attempting to bind port 491a1093-71aa-47a5-936a-f29926efe34c on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:39:42.203830 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Attempting to bind port 491a1093-71aa-47a5-936a-f29926efe34c by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:39:42.204260 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Attempting to bind port 491a1093-71aa-47a5-936a-f29926efe34c on network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:39:42.211849 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:39:42.212211 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Checking segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:42.212616 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.213003 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Bound using segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:39:42.213848 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Bound port: 491a1093-71aa-47a5-936a-f29926efe34c, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:39:42.214227 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.214370 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Allocated IP 172.27.3.247 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/24e0873b-9da9-49d9-adc3-e64d3d354616) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:39:42.281508 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] For port 491a1093-71aa-47a5-936a-f29926efe34c, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:39:42.284955 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] For port 491a1093-71aa-47a5-936a-f29926efe34c, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=491a1093-71aa-47a5-936a-f29926efe34c,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:39:42.292270 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.318967 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.352438 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e50a790-ed31-418d-9a6c-51d12307c2f9 None None] Pushing event updated for resources: {'Port': ['ID=491a1093-71aa-47a5-936a-f29926efe34c,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:42.363163 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:42.401248 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:42.405477 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:42.408097 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:39:42.416505 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Pushing event updated for resources: {'Port': ['ID=24e0873b-9da9-49d9-adc3-e64d3d354616,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:42.918187 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.114323 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.123814 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-340bf07c-53cc-4840-9519-c384fd4b90eb None None] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:39:43.198346 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-ad210846-8da4-495f-ac2e-3a8171762c6c None None] Provisioning complete for port 491a1093-71aa-47a5-936a-f29926efe34c triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:43.198709 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ad210846-8da4-495f-ac2e-3a8171762c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.243405 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Router 75865ab2-4183-4e8a-beb5-a2ccba525741 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93951) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:39:43.338150 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ad210846-8da4-495f-ac2e-3a8171762c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.347066 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:39:43.362289 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Sync routers for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:39:43.366280 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.370153 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-a9baa5c4-f3fc-4eaa-a067-62b685280ef8 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.6870472 Sep 16 16:39:43.370623 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45282) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:43.384495 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-ad210846-8da4-495f-ac2e-3a8171762c6c None None] For port 491a1093-71aa-47a5-936a-f29926efe34c, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=491a1093-71aa-47a5-936a-f29926efe34c,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:39:43.385921 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:43.386557 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:43.420264 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ad210846-8da4-495f-ac2e-3a8171762c6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.513389 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad210846-8da4-495f-ac2e-3a8171762c6c None None] Pushing event updated for resources: {'Port': ['ID=491a1093-71aa-47a5-936a-f29926efe34c,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:43.530312 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:43.658597 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-efbf2c01-4e7c-42e5-85ea-7bdd808190d8 None None] Provisioning complete for port 491a1093-71aa-47a5-936a-f29926efe34c triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:43.658858 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-efbf2c01-4e7c-42e5-85ea-7bdd808190d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.774043 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:42Z', 'revision_number': 3, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:43.788043 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.808346 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Checking router: 75865ab2-4183-4e8a-beb5-a2ccba525741 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:39:43.808692 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Updating router 75865ab2-4183-4e8a-beb5-a2ccba525741 port 24e0873b-9da9-49d9-adc3-e64d3d354616 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:39:43.832748 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:43.938101 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Allocated IP 172.20.0.1 (5b1e1b97-8da3-4734-a096-dcc18d4c91f6/ae0084a1-dbaa-404c-a430-61ff268bd88f/61fa556e-7662-4fc1-ab31-b6142b80b477) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:39:44.039746 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.072295 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.076973 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.083218 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.109193 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:44.114473 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:44.116795 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:39:44.133154 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Attempting to bind port 24e0873b-9da9-49d9-adc3-e64d3d354616 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:39:44.133702 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Attempting to bind port 24e0873b-9da9-49d9-adc3-e64d3d354616 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:39:44.134362 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Attempting to bind port 24e0873b-9da9-49d9-adc3-e64d3d354616 on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:39:44.139108 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419aae07-6a4a-4a98-afa2-6b92626c404c None None] Pushing event updated for resources: {'Port': ['ID=24e0873b-9da9-49d9-adc3-e64d3d354616,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:44.146087 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Pushing event updated for resources: {'Port': ['ID=61fa556e-7662-4fc1-ab31-b6142b80b477,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:44.147839 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:39:44.148198 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:44.148609 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.149002 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:39:44.149497 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Bound port: 24e0873b-9da9-49d9-adc3-e64d3d354616, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:39:44.150051 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.167095 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.215788 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] For port 24e0873b-9da9-49d9-adc3-e64d3d354616, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:39:44.219252 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] For port 24e0873b-9da9-49d9-adc3-e64d3d354616, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=24e0873b-9da9-49d9-adc3-e64d3d354616,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:39:44.226363 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.286513 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 491a1093-71aa-47a5-936a-f29926efe34c up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:44.332714 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:44.333339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:44.335843 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.338252 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419aae07-6a4a-4a98-afa2-6b92626c404c None None] Pushing event updated for resources: {'Port': ['ID=24e0873b-9da9-49d9-adc3-e64d3d354616,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:44.502454 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.508900 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.566402 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 491a1093-71aa-47a5-936a-f29926efe34c triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:44.566653 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.573852 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Pushing event updated for resources: {'Port': ['ID=61fa556e-7662-4fc1-ab31-b6142b80b477,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:44.576417 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.589685 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-126fce40-2858-444c-9f28-249445a6fd44 None None] Provisioning complete for port 61fa556e-7662-4fc1-ab31-b6142b80b477 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:44.590053 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-126fce40-2858-444c-9f28-249445a6fd44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.635408 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:44.669915 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:44.671352 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:44.682446 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-126fce40-2858-444c-9f28-249445a6fd44 None None] Port 61fa556e-7662-4fc1-ab31-b6142b80b477 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:39:44.789435 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Router 75865ab2-4183-4e8a-beb5-a2ccba525741 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:39:44.890875 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:43Z', 'revision_number': 1, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:44.906587 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:39:44.919985 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-119af276-7206-4abe-b84d-bc4810f8be64 admin admin] 10.222.0.59 "PUT /v2.0/routers/75865ab2-4183-4e8a-beb5-a2ccba525741/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5403101 Sep 16 16:39:44.926790 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2efbcc7d-169f-447b-8ea6-228ad5c5e44e None None] The sync data for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi is: [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:43Z', 'revision_number': 1, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:39:44.933978 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-e9e0b788-8986-4e80-8979-1adadc2ac1fa None None] Provisioning complete for port 61fa556e-7662-4fc1-ab31-b6142b80b477 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:44.934349 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e9e0b788-8986-4e80-8979-1adadc2ac1fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:44.968614 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-e9e0b788-8986-4e80-8979-1adadc2ac1fa None None] Port 61fa556e-7662-4fc1-ab31-b6142b80b477 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:39:45.414771 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45298) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:45.419963 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1640464691-network', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:39:45.443615 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Made reservation on behalf of 0eb3e1ccc0654326a889abb8b6202e57 for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:39:45.446001 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.455136 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.554687 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.558966 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.586290 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 716} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:39:45.596736 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc1e9728-dade-4366-8879-547a5c62c9ea,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:45.603671 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.604010 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Added segment c61b3e3c-5a37-485c-a517-77e7bc7bf973 of type vlan for network fed07361-ae74-4116-ade3-e34c97349938 Sep 16 16:39:45.646806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.672683 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.673741 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:39:45.674432 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.711157 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.2950447 Sep 16 16:39:45.714114 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45300) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:45.719065 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Request body: {'subnet': {'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1640464691-subnet', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:39:45.741677 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Made reservation on behalf of 0eb3e1ccc0654326a889abb8b6202e57 for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:39:45.743152 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42982c8b-4e41-458f-a9ee-df7a32164c21 admin admin] Pushing event updated for resources: {'Network': ['ID=fed07361-ae74-4116-ade3-e34c97349938,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:45.744550 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58434343'] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.753770 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network fed07361-ae74-4116-ade3-e34c97349938 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:39:45.916105 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.930253 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-58361794', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58434313'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:45.987445 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=269ea7ae-12a6-4fec-a8cc-02210abc6f6d,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:45.994633 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Checking segment: {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:45.994992 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Network hostable DHCP agents. Network: fed07361-ae74-4116-ade3-e34c97349938, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:39:46.011944 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Network fed07361-ae74-4116-ade3-e34c97349938 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:39:46.021801 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, fed07361-ae74-4116-ade3-e34c97349938) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:46.026015 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:39:46.026777 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.030600 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d49b410-8afe-4139-bac1-0eb557791b70 None None] Network fed07361-ae74-4116-ade3-e34c97349938 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:39:46.045363 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-b40a9c71-0812-4af2-b252-6835ad57c7e8 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3301570 Sep 16 16:39:46.048033 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45302) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:46.052874 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:39:46.073883 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.075151 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.124916 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.185122 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-fed07361-ae74-4116-ade3-e34c97349938', 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'fixed_ips': [{'subnet_id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:39:46.186226 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.273823 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24e0873b-9da9-49d9-adc3-e64d3d354616 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:46.286214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.370146 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 24e0873b-9da9-49d9-adc3-e64d3d354616 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:46.370520 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.394636 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Allocated IP 172.20.0.2 (fed07361-ae74-4116-ade3-e34c97349938/269ea7ae-12a6-4fec-a8cc-02210abc6f6d/cafa3ea1-78ef-47ef-8e62-975bb2b95fb8) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:39:46.481211 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.500771 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.527701 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.577333 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 24e0873b-9da9-49d9-adc3-e64d3d354616, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=24e0873b-9da9-49d9-adc3-e64d3d354616,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:39:46.584580 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.608307 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Allocated IP 172.27.3.222 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/9c6cdacf-2d80-4f00-9380-139ce96d3989) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:39:46.631355 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.639752 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.661192 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=24e0873b-9da9-49d9-adc3-e64d3d354616,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:46.693813 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Network fed07361-ae74-4116-ade3-e34c97349938 is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:46.696772 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:46.700519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:39:46.717666 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.734745 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Pushing event updated for resources: {'Port': ['ID=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:46.756828 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.765004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Attempting to bind port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:39:46.765543 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Attempting to bind port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:39:46.765743 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Attempting to bind port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 on network fed07361-ae74-4116-ade3-e34c97349938 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:39:46.771004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:39:46.771325 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Checking segment: {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:46.771727 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.772265 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Bound using segment: {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:39:46.772642 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Bound port: cafa3ea1-78ef-47ef-8e62-975bb2b95fb8, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:39:46.773022 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.793724 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:46.798325 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:46.802344 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:39:46.804051 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Sync routers for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:39:46.813281 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:46.813899 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:46.826962 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Pushing event updated for resources: {'Port': ['ID=9c6cdacf-2d80-4f00-9380-139ce96d3989,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:46.853837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] For port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:39:46.857663 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] For port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,segment=NetworkSegment(c61b3e3c-5a37-485c-a517-77e7bc7bf973),segment_id=c61b3e3c-5a37-485c-a517-77e7bc7bf973)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:39:46.862134 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:46.927371 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:46.931028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdcbf2b-eb9e-4986-9d38-ef2be876b888 None None] Pushing event updated for resources: {'Port': ['ID=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:47.065965 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.160224 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 2, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:47.187367 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Checking router: 75865ab2-4183-4e8a-beb5-a2ccba525741 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:39:47.187868 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Updating router 75865ab2-4183-4e8a-beb5-a2ccba525741 port 61fa556e-7662-4fc1-ab31-b6142b80b477 binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:39:47.218986 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.286497 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.413154 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Router b58ec9d8-89ba-4ea4-9df3-441a86c90754 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93950) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:39:47.492378 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.497921 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.516401 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:39:47.525787 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Sync routers for ids ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:39:47.539744 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Pushing event updated for resources: {'Port': ['ID=61fa556e-7662-4fc1-ab31-b6142b80b477,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:47.541311 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Routers {'b58ec9d8-89ba-4ea4-9df3-441a86c90754'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:47.542010 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:47.546207 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.547558 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-feac2419-3088-4a3c-b87c-f64011118d0c admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.4981642 Sep 16 16:39:47.549950 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45304) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:39:47.598441 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.599541 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.599541 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.599541 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.599843 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.600102 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.600416 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.600735 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.601088 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.601397 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.601710 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.602023 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:39:47.626415 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Attempting to bind port 61fa556e-7662-4fc1-ab31-b6142b80b477 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:39:47.626723 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Attempting to bind port 61fa556e-7662-4fc1-ab31-b6142b80b477 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:39:47.627092 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Attempting to bind port 61fa556e-7662-4fc1-ab31-b6142b80b477 on network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:39:47.633165 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:39:47.633476 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Checking segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:47.633766 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.634159 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Bound using segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:39:47.634628 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Bound port: 61fa556e-7662-4fc1-ab31-b6142b80b477, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:39:47.635026 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.709471 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Set router b58ec9d8-89ba-4ea4-9df3-441a86c90754 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:47.720471 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] For port 61fa556e-7662-4fc1-ab31-b6142b80b477, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:39:47.724435 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] For port 61fa556e-7662-4fc1-ab31-b6142b80b477, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=61fa556e-7662-4fc1-ab31-b6142b80b477,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:39:47.735740 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.800776 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fb813b6-5b55-4090-9303-f53dc9d9e48d None None] Pushing event updated for resources: {'Port': ['ID=61fa556e-7662-4fc1-ab31-b6142b80b477,revision_number=4']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:47.820698 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:47.822569 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:47.954517 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-9f593223-a67e-4f12-86dc-97dd814289d8 None None] Provisioning complete for port 61fa556e-7662-4fc1-ab31-b6142b80b477 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:47.955471 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9f593223-a67e-4f12-86dc-97dd814289d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:47.973539 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:48.036847 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 3, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:48.084786 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Checking router: b58ec9d8-89ba-4ea4-9df3-441a86c90754 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:39:48.085215 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Updating router b58ec9d8-89ba-4ea4-9df3-441a86c90754 port 9c6cdacf-2d80-4f00-9380-139ce96d3989 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:39:48.123655 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9f593223-a67e-4f12-86dc-97dd814289d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.127966 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.129700 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0dcd1fc-97c2-4226-aaac-1ccd905197cd None None] Network fed07361-ae74-4116-ade3-e34c97349938 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:39:48.228131 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-9f593223-a67e-4f12-86dc-97dd814289d8 None None] For port 61fa556e-7662-4fc1-ab31-b6142b80b477, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=61fa556e-7662-4fc1-ab31-b6142b80b477,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:39:48.259728 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9f593223-a67e-4f12-86dc-97dd814289d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.260844 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:47Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:48.313803 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4098d571-5795-4f7f-b40a-9f9045cda6a7 None None] The sync data for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi is: [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:47Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:39:48.417032 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.471852 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24e0873b-9da9-49d9-adc3-e64d3d354616 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:48.568165 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Provisioning complete for port 61fa556e-7662-4fc1-ab31-b6142b80b477 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:48.568541 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.581052 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Allocated IP 172.20.0.1 (fed07361-ae74-4116-ade3-e34c97349938/269ea7ae-12a6-4fec-a8cc-02210abc6f6d/9ed0a2bb-0c19-4de4-b539-4815562e72f4) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:39:48.615852 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f593223-a67e-4f12-86dc-97dd814289d8 None None] Pushing event updated for resources: {'Port': ['ID=61fa556e-7662-4fc1-ab31-b6142b80b477,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:48.705601 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.733442 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 24e0873b-9da9-49d9-adc3-e64d3d354616 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:48.733714 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.744963 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.783973 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Network fed07361-ae74-4116-ade3-e34c97349938 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:48.786917 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:48.790355 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:39:48.821143 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Pushing event updated for resources: {'Port': ['ID=9ed0a2bb-0c19-4de4-b539-4815562e72f4,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:48.836004 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.924755 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.942351 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Provisioning complete for port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:48.942484 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.947860 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:48.970261 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 61fa556e-7662-4fc1-ab31-b6142b80b477 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:48.996085 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.067613 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0e0bd9-bf7c-4f58-8c8c-d453426458bf None None] Pushing event updated for resources: {'Port': ['ID=9c6cdacf-2d80-4f00-9380-139ce96d3989,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:49.072160 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Attempting to bind port 9c6cdacf-2d80-4f00-9380-139ce96d3989 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:39:49.072543 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Attempting to bind port 9c6cdacf-2d80-4f00-9380-139ce96d3989 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:39:49.072896 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Attempting to bind port 9c6cdacf-2d80-4f00-9380-139ce96d3989 on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:39:49.083380 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:39:49.083766 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:49.084172 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.084574 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:39:49.085036 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Bound port: 9c6cdacf-2d80-4f00-9380-139ce96d3989, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:39:49.085832 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.165268 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 61fa556e-7662-4fc1-ab31-b6142b80b477 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:49.165651 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.171389 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.176641 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.184464 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.208644 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] For port 9c6cdacf-2d80-4f00-9380-139ce96d3989, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:39:49.231310 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] For port 9c6cdacf-2d80-4f00-9380-139ce96d3989, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=9c6cdacf-2d80-4f00-9380-139ce96d3989,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:39:49.245622 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.261439 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Pushing event updated for resources: {'Port': ['ID=9ed0a2bb-0c19-4de4-b539-4815562e72f4,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:49.267864 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.281702 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] For port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,segment=NetworkSegment(c61b3e3c-5a37-485c-a517-77e7bc7bf973),segment_id=c61b3e3c-5a37-485c-a517-77e7bc7bf973)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:39:49.293726 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.342846 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Routers {'b58ec9d8-89ba-4ea4-9df3-441a86c90754'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:49.343488 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:49.347690 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0e0bd9-bf7c-4f58-8c8c-d453426458bf None None] Pushing event updated for resources: {'Port': ['ID=9c6cdacf-2d80-4f00-9380-139ce96d3989,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:49.362227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Network fed07361-ae74-4116-ade3-e34c97349938 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:39:49.363769 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:39:49.423337 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:49.481783 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Router b58ec9d8-89ba-4ea4-9df3-441a86c90754 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:39:49.523724 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-12e740af-570f-4bec-8dce-d7bf35ee256c None None] Provisioning complete for port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:49.524082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-12e740af-570f-4bec-8dce-d7bf35ee256c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.550250 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-405f718e-8d33-44de-bc72-b2df70cb850f None None] Pushing event updated for resources: {'Port': ['ID=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:49.577768 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] Set router b58ec9d8-89ba-4ea4-9df3-441a86c90754 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:49.594143 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:39:49.603087 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e725e6f8-1763-4f9d-ac94-c9fec5fcafd4 admin admin] 10.222.0.59 "PUT /v2.0/routers/b58ec9d8-89ba-4ea4-9df3-441a86c90754/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0480740 Sep 16 16:39:49.612342 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-12e740af-570f-4bec-8dce-d7bf35ee256c None None] Port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:39:49.615960 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:49.616334 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.704605 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-12e740af-570f-4bec-8dce-d7bf35ee256c None None] Provisioning complete for port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:49.704984 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-12e740af-570f-4bec-8dce-d7bf35ee256c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:49.925793 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '9ed0a2bb-0c19-4de4-b539-4815562e72f4', 'name': '', 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'mac_address': 'fa:16:3e:b1:6b:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:48Z', 'updated_at': '2021-09-16T16:39:49Z', 'revision_number': 2, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'subnets': [{'id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:49.955969 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0297a84a-a3d5-4c4e-b733-4008b4ed6984 None None] The sync data for ids ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'] in dv-cinder-805887-15-iscsi is: [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '9ed0a2bb-0c19-4de4-b539-4815562e72f4', 'name': '', 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'mac_address': 'fa:16:3e:b1:6b:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:48Z', 'updated_at': '2021-09-16T16:39:49Z', 'revision_number': 2, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'subnets': [{'id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:39:50.025807 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-22ec0d0e-3e90-4638-937b-fb3943d921b1 None None] Provisioning complete for port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:50.026491 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-22ec0d0e-3e90-4638-937b-fb3943d921b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:50.063372 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-22ec0d0e-3e90-4638-937b-fb3943d921b1 None None] Port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:39:50.245718 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:50.297105 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:50.297533 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:50.553994 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 61fa556e-7662-4fc1-ab31-b6142b80b477 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:50.615964 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 61fa556e-7662-4fc1-ab31-b6142b80b477 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:50.616444 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:50.737646 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b4d44131-17e2-4544-9e1c-6b0d8b07af84 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:52.258542 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9c6cdacf-2d80-4f00-9380-139ce96d3989 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:52.320699 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 9c6cdacf-2d80-4f00-9380-139ce96d3989 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:52.321159 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:52.405263 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:52.426482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 9c6cdacf-2d80-4f00-9380-139ce96d3989, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=9c6cdacf-2d80-4f00-9380-139ce96d3989,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:39:52.430718 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:52.479915 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Sync routers for ids ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:39:52.489158 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=9c6cdacf-2d80-4f00-9380-139ce96d3989,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:52.500176 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Routers {'b58ec9d8-89ba-4ea4-9df3-441a86c90754'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:52.500673 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:52.610163 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Set router b58ec9d8-89ba-4ea4-9df3-441a86c90754 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:52.904716 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '9ed0a2bb-0c19-4de4-b539-4815562e72f4', 'name': '', 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'mac_address': 'fa:16:3e:b1:6b:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:48Z', 'updated_at': '2021-09-16T16:39:49Z', 'revision_number': 2, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'subnets': [{'id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:52.938456 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Checking router: b58ec9d8-89ba-4ea4-9df3-441a86c90754 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:39:52.938970 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Updating router b58ec9d8-89ba-4ea4-9df3-441a86c90754 port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:39:52.968615 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.250587 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.258185 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.342697 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc8a6a6-1f8e-4b67-95e6-e613c555d87d None None] Pushing event updated for resources: {'Port': ['ID=9ed0a2bb-0c19-4de4-b539-4815562e72f4,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:53.374032 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Attempting to bind port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:39:53.374541 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Attempting to bind port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:39:53.374996 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Attempting to bind port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 on network fed07361-ae74-4116-ade3-e34c97349938 {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:39:53.381404 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:39:53.381903 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Checking segment: {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:39:53.382399 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.382879 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Bound using segment: {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:39:53.383477 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Bound port: 9ed0a2bb-0c19-4de4-b539-4815562e72f4, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c61b3e3c-5a37-485c-a517-77e7bc7bf973', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 716, 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:39:53.383977 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.450266 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-12c62c9a-7d65-4ddc-bfa1-f35174157698 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.470320 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] For port 9ed0a2bb-0c19-4de4-b539-4815562e72f4, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:39:53.474642 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] For port 9ed0a2bb-0c19-4de4-b539-4815562e72f4, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=9ed0a2bb-0c19-4de4-b539-4815562e72f4,segment=NetworkSegment(c61b3e3c-5a37-485c-a517-77e7bc7bf973),segment_id=c61b3e3c-5a37-485c-a517-77e7bc7bf973)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:39:53.479715 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.542067 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc8a6a6-1f8e-4b67-95e6-e613c555d87d None None] Pushing event updated for resources: {'Port': ['ID=9ed0a2bb-0c19-4de4-b539-4815562e72f4,revision_number=4']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:53.554369 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Routers {'b58ec9d8-89ba-4ea4-9df3-441a86c90754'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:39:53.555225 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:39:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:53.611464 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-3a11b9c8-3914-4f46-9b6e-c4af1939d7a2 None None] Provisioning complete for port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:53.614623 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3a11b9c8-3914-4f46-9b6e-c4af1939d7a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.670041 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] Set router b58ec9d8-89ba-4ea4-9df3-441a86c90754 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:39:53.714049 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3a11b9c8-3914-4f46-9b6e-c4af1939d7a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.748719 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-3a11b9c8-3914-4f46-9b6e-c4af1939d7a2 None None] For port 9ed0a2bb-0c19-4de4-b539-4815562e72f4, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=9ed0a2bb-0c19-4de4-b539-4815562e72f4,segment=NetworkSegment(c61b3e3c-5a37-485c-a517-77e7bc7bf973),segment_id=c61b3e3c-5a37-485c-a517-77e7bc7bf973)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:39:53.761641 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3a11b9c8-3914-4f46-9b6e-c4af1939d7a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.792445 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.819190 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a11b9c8-3914-4f46-9b6e-c4af1939d7a2 None None] Pushing event updated for resources: {'Port': ['ID=9ed0a2bb-0c19-4de4-b539-4815562e72f4,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:39:53.883993 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-37d89dbb-1ed8-459b-83cb-acc1b150c50d None None] Provisioning complete for port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:53.884372 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-37d89dbb-1ed8-459b-83cb-acc1b150c50d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:53.916128 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '9ed0a2bb-0c19-4de4-b539-4815562e72f4', 'name': '', 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'mac_address': 'fa:16:3e:b1:6b:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:48Z', 'updated_at': '2021-09-16T16:39:53Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'subnets': [{'id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:39:53.949572 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76229812-bb56-43b0-b7f7-d125f26faf87 None None] The sync data for ids ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'] in dv-cinder-805887-15-iscsi is: [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '9ed0a2bb-0c19-4de4-b539-4815562e72f4', 'name': '', 'network_id': 'fed07361-ae74-4116-ade3-e34c97349938', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'mac_address': 'fa:16:3e:b1:6b:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:48Z', 'updated_at': '2021-09-16T16:39:53Z', 'revision_number': 4, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'subnets': [{'id': '269ea7ae-12a6-4fec-a8cc-02210abc6f6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:39:54.294577 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9c6cdacf-2d80-4f00-9380-139ce96d3989 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:54.348400 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 9c6cdacf-2d80-4f00-9380-139ce96d3989 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:54.348919 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:54.455678 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:54.457910 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9ed0a2bb-0c19-4de4-b539-4815562e72f4 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:39:54.512038 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:39:54.512685 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:56.269731 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:39:59.464346 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-a556f011-4666-4b62-ac23-504c749fbc93 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:39:59.465804 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-a556f011-4666-4b62-ac23-504c749fbc93 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 814 time: 0.1018829 Sep 16 16:39:59.480193 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-5cb0e0a2-ecff-4497-9448-bcde5e1213e5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/quotas/8b9df3c8324941d482822ccfbb50493d HTTP/1.1" status: 200 len: 375 time: 0.0086782 Sep 16 16:39:59.528391 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-584b667f-cf33-47a1-8d31-940375da0372 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0431604 Sep 16 16:39:59.631047 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-d79d265c-b977-4942-a02f-ff0be54d2b33 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:39:59.632190 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-d79d265c-b977-4942-a02f-ff0be54d2b33 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0929086 Sep 16 16:39:59.722503 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-253ca3d8-ef09-4fac-95f4-d60c61c1f416 service neutron] 10.222.0.59 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841229 Sep 16 16:40:00.054240 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-0f706d4a-f768-46bb-b584-52366547c254 service neutron] 10.222.0.59 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3257298 Sep 16 16:40:00.211384 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2ad358f7-e7ea-48f1-8373-2ed3ed22d852 req-0a7f4b92-802b-4206-80c7-da6cda132afa tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 210 time: 0.0267916 Sep 16 16:40:01.270462 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-0e865253-b18e-4f07-9479-a95cc2fd55b6 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:01.271957 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-0e865253-b18e-4f07-9479-a95cc2fd55b6 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 814 time: 0.1064825 Sep 16 16:40:01.291496 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'port': {'device_id': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'admin_state_up': True, 'tenant_id': '8b9df3c8324941d482822ccfbb50493d'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:01.319262 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-898b6f7c-f981-4a6c-95dd-f85d07b377a2 req-a9cdab31-2612-4efe-8219-718fb1589385 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 210 time: 0.0406694 Sep 16 16:40:01.414785 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Made reservation on behalf of 8b9df3c8324941d482822ccfbb50493d for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:40:01.418364 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:01.544088 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Allocated IP 172.20.0.5 (5b1e1b97-8da3-4734-a096-dcc18d4c91f6/ae0084a1-dbaa-404c-a430-61ff268bd88f/468f0d50-535d-45b9-b22e-a7612070713d) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:40:01.753549 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:01.793274 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:01.821014 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:40:01.823496 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:40:01.842455 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:40:01.917057 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:01.918110 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:01.933818 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:01.949316 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-c8497c9d-818a-41e2-a05a-c63b698d9e43 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6624029 Sep 16 16:40:02.076658 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-1d328c49-11ce-497a-9e0e-9e089c817b43 None None] Provisioning complete for port 468f0d50-535d-45b9-b22e-a7612070713d triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:40:02.077262 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1d328c49-11ce-497a-9e0e-9e089c817b43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:02.116963 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-1d328c49-11ce-497a-9e0e-9e089c817b43 None None] Port 468f0d50-535d-45b9-b22e-a7612070713d cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:40:02.449694 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f075312c-2a74-41ff-b46f-cf497a67fe6b req-558c52e3-2f1b-4516-837b-3996aaadb0d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:02.452224 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f075312c-2a74-41ff-b46f-cf497a67fe6b req-558c52e3-2f1b-4516-837b-3996aaadb0d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0607941 Sep 16 16:40:02.521973 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f075312c-2a74-41ff-b46f-cf497a67fe6b req-be4d0529-1621-41b3-9658-e03fa5bd6a3f tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631185 Sep 16 16:40:03.639425 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6319b8a-01b3-4fca-a644-3492be9518b3 req-134e7a5d-7fce-4af7-84ab-39521e43414d tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:03.641510 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6319b8a-01b3-4fca-a644-3492be9518b3 req-134e7a5d-7fce-4af7-84ab-39521e43414d tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0595057 Sep 16 16:40:03.679271 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d6319b8a-01b3-4fca-a644-3492be9518b3 req-be9419d5-c3a9-48d3-b735-2cc869fa72b9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315571 Sep 16 16:40:04.827880 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e51a28-a418-4d0e-bd17-94cce49c67c3 req-c9b499bc-3525-4d57-9161-25e8d05505f8 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:04.829419 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b9e51a28-a418-4d0e-bd17-94cce49c67c3 req-c9b499bc-3525-4d57-9161-25e8d05505f8 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0548651 Sep 16 16:40:04.867863 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b9e51a28-a418-4d0e-bd17-94cce49c67c3 req-eda67922-d398-4a58-8519-56a3edd2258f tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317476 Sep 16 16:40:05.985652 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09d1fec-51b3-4d08-8288-26060e96a1cc req-d67c5054-3a99-4334-9559-3216101e4f93 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:05.987176 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e09d1fec-51b3-4d08-8288-26060e96a1cc req-d67c5054-3a99-4334-9559-3216101e4f93 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0497525 Sep 16 16:40:06.030337 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e09d1fec-51b3-4d08-8288-26060e96a1cc req-2649c81f-a9dc-4543-ac97-03edf7cf9aca tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343535 Sep 16 16:40:07.146351 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7910b1d1-abf2-4957-b238-8f56c8c7481f req-094e8c9d-46f0-4b55-a226-c32131214860 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:07.147888 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7910b1d1-abf2-4957-b238-8f56c8c7481f req-094e8c9d-46f0-4b55-a226-c32131214860 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0502019 Sep 16 16:40:07.186177 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7910b1d1-abf2-4957-b238-8f56c8c7481f req-27d557ba-6485-44ca-9418-730a7b53537c tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323207 Sep 16 16:40:08.320027 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b438ae4-9e78-49e8-8d23-5251be5eebf4 req-bf5f64e8-08de-40c2-acaa-63c63c0dad35 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:08.321615 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0b438ae4-9e78-49e8-8d23-5251be5eebf4 req-bf5f64e8-08de-40c2-acaa-63c63c0dad35 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0621178 Sep 16 16:40:08.370236 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0b438ae4-9e78-49e8-8d23-5251be5eebf4 req-52692906-8f35-4294-8f6a-2a7c9b44eb32 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424821 Sep 16 16:40:09.486449 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43cccda3-d9e5-40d7-9db9-b80a44a203ab req-347490a5-83f0-4f9e-95a2-5dc2d3574408 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:09.487933 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-43cccda3-d9e5-40d7-9db9-b80a44a203ab req-347490a5-83f0-4f9e-95a2-5dc2d3574408 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0484788 Sep 16 16:40:09.526500 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-43cccda3-d9e5-40d7-9db9-b80a44a203ab req-1fb4ecd1-1037-48b4-8351-f65dfeb5c29f tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326712 Sep 16 16:40:10.646803 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad336bb-c2d3-4cc9-81d1-d9cde702e5bf req-9126808a-3817-49c5-aad3-7c7389aa7710 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:10.648480 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5ad336bb-c2d3-4cc9-81d1-d9cde702e5bf req-9126808a-3817-49c5-aad3-7c7389aa7710 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0516002 Sep 16 16:40:10.685752 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-5ad336bb-c2d3-4cc9-81d1-d9cde702e5bf req-9f9cf2c2-c407-4baa-9a11-aed8df6401e2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315368 Sep 16 16:40:11.755484 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Request body: {'port': {'device_id': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:11.803590 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72aa6c30-12f9-4efc-881a-b6a11d22e7f4 req-1a21e17a-fd32-4c38-94d0-19de2d6a5cb4 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:11.805065 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-72aa6c30-12f9-4efc-881a-b6a11d22e7f4 req-1a21e17a-fd32-4c38-94d0-19de2d6a5cb4 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 931 time: 0.0544174 Sep 16 16:40:11.808265 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:11.843874 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-72aa6c30-12f9-4efc-881a-b6a11d22e7f4 req-12d92398-06fc-4bcc-a486-38d59680739c tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323493 Sep 16 16:40:12.067285 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 468f0d50-535d-45b9-b22e-a7612070713d {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:40:12.074364 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:12.085652 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Transition to ACTIVE for port object 468f0d50-535d-45b9-b22e-a7612070713d will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:40:12.088833 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:12.138938 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:12.205540 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Attempting to bind port 468f0d50-535d-45b9-b22e-a7612070713d on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:40:12.205870 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Attempting to bind port 468f0d50-535d-45b9-b22e-a7612070713d by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:40:12.210021 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Attempting to bind port 468f0d50-535d-45b9-b22e-a7612070713d on network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:40:12.210885 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Port 468f0d50-535d-45b9-b22e-a7612070713d on network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:40:12.211235 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Attempting to bind port 468f0d50-535d-45b9-b22e-a7612070713d on network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:40:12.216172 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 39, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:40:12.216505 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Checking segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:40:12.216943 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Bound using segment: {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:40:12.217289 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Bound port: 468f0d50-535d-45b9-b22e-a7612070713d, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2065031c-0eec-4fd2-9ec0-667b568e60f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 747, 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:40:12.217697 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:12.281273 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:40:12.284189 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:40:12.294564 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:12.334207 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.334732 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:12.336144 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] 10.222.0.66 "PUT /v2.0/ports/468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 1093 time: 0.5859327 Sep 16 16:40:12.336570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:40:12.338809 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5961955-0477-4dba-80bc-1361bd515da8" -d '{"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:40:12.367541 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787d6964-829c-45cb-b44a-c680f96707d0 service neutron] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:12.387088 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:40:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d500247d-db88-418a-abac-31597fdfa353 x-openstack-request-id: req-d500247d-db88-418a-abac-31597fdfa353 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:40:12.387315 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:40:12.387562 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-d500247d-db88-418a-abac-31597fdfa353 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:40:12.387956 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'status': 'completed', 'code': 200} Sep 16 16:40:12.421794 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-9c04ee73-86c8-4bd7-beba-32b6a8e79f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.423349 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-9c04ee73-86c8-4bd7-beba-32b6a8e79f6f service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1096 time: 0.0460112 Sep 16 16:40:12.468883 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-ad1749ad-0458-432b-bb96-bffbb7ea8e3b service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 217 time: 0.0375915 Sep 16 16:40:12.521542 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-4753bb7e-a07d-497b-9e65-c76d6f315e8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.522996 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-4753bb7e-a07d-497b-9e65-c76d6f315e8f service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0468881 Sep 16 16:40:12.568162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-1b58c096-0017-4101-8391-ffc31fcc28f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.569584 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-1b58c096-0017-4101-8391-ffc31fcc28f2 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0390508 Sep 16 16:40:12.658035 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-922a1fee-f0d9-43c1-bdec-e7e626da8800 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808403 Sep 16 16:40:12.742407 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e8995a24-ee84-489e-84c2-4fea2ff14544 req-fd078013-b43b-45fd-905d-dca2fa9d6df2 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0779073 Sep 16 16:40:12.831011 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5961955-0477-4dba-80bc-1361bd515da8 req-69e244a4-9320-4ff6-9a4a-cd6f1540ffb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.832495 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-69e244a4-9320-4ff6-9a4a-cd6f1540ffb1 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1096 time: 0.0439658 Sep 16 16:40:12.921020 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5961955-0477-4dba-80bc-1361bd515da8 req-561d22d8-e639-4080-bc54-c86237e2ea6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.922501 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-561d22d8-e639-4080-bc54-c86237e2ea6b service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.0814726 Sep 16 16:40:12.955822 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681ab7db-6bd9-42fb-830e-68d946fb11c3 req-0f6f7faf-eb8f-4cf1-8e0d-3a9d65909b93 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:12.957346 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-681ab7db-6bd9-42fb-830e-68d946fb11c3 req-0f6f7faf-eb8f-4cf1-8e0d-3a9d65909b93 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 943 time: 0.0488100 Sep 16 16:40:12.967168 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-e1262337-47b3-4354-b6e1-a217b2f3b863 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 217 time: 0.0369952 Sep 16 16:40:12.995227 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-681ab7db-6bd9-42fb-830e-68d946fb11c3 req-db3d5d32-8fdd-43c2-98e4-386193cd65eb tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319631 Sep 16 16:40:13.024619 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5961955-0477-4dba-80bc-1361bd515da8 req-133a0d43-fb90-4520-b74a-5204e52f2ba7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:13.026057 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-133a0d43-fb90-4520-b74a-5204e52f2ba7 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0517249 Sep 16 16:40:13.074374 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5961955-0477-4dba-80bc-1361bd515da8 req-baef7589-6c34-477b-ba1d-f40a527ad04c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:13.076786 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-baef7589-6c34-477b-ba1d-f40a527ad04c service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0427465 Sep 16 16:40:13.168720 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-e7deaa82-a893-410d-b8fb-9925281bf9b5 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829616 Sep 16 16:40:13.256587 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d5961955-0477-4dba-80bc-1361bd515da8 req-76eedd56-1e7c-4573-830e-d47a3df274c1 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792627 Sep 16 16:40:14.108445 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f12e4c-9999-4bdf-b5c0-533f445e2ce4 req-96640e38-609f-4049-8597-fb56b0622e42 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:14.109883 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-41f12e4c-9999-4bdf-b5c0-533f445e2ce4 req-96640e38-609f-4049-8597-fb56b0622e42 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 943 time: 0.0482268 Sep 16 16:40:14.149343 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-41f12e4c-9999-4bdf-b5c0-533f445e2ce4 req-0427e2b1-ef4b-4694-8c11-7054474d45eb tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335841 Sep 16 16:40:14.638955 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 468f0d50-535d-45b9-b22e-a7612070713d details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:40:14.731296 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:40:14.743141 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': '468f0d50-535d-45b9-b22e-a7612070713d', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'port_id': '468f0d50-535d-45b9-b22e-a7612070713d', 'mac_address': 'fa:16:3e:78:9f:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 747, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:40:14.777649 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:14.790097 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 468f0d50-535d-45b9-b22e-a7612070713d {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:40:14.809447 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:40:14.813450 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:14.858138 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:15.027407 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:40:15.060029 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['468f0d50-535d-45b9-b22e-a7612070713d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:40:15.260146 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d920aaf-ecc6-4962-86ce-19a6245bd996 req-5a68711c-05cd-4531-9161-34b16b5c6567 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:15.261602 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5d920aaf-ecc6-4962-86ce-19a6245bd996 req-5a68711c-05cd-4531-9161-34b16b5c6567 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 944 time: 0.0472777 Sep 16 16:40:15.297944 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-5d920aaf-ecc6-4962-86ce-19a6245bd996 req-f502c594-13a2-4fbc-8636-25bac4cd1a3c tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305209 Sep 16 16:40:15.900589 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:16.410895 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3372c953-2a1a-4688-836b-7070c6deba2a req-ff42f896-e3a7-4e37-97f8-6443be55f65c tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:16.412412 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3372c953-2a1a-4688-836b-7070c6deba2a req-ff42f896-e3a7-4e37-97f8-6443be55f65c tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 944 time: 0.0492058 Sep 16 16:40:16.452619 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3372c953-2a1a-4688-836b-7070c6deba2a req-025f78b9-df51-46fa-8328-ed2dd77b79f6 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341303 Sep 16 16:40:16.669892 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 468f0d50-535d-45b9-b22e-a7612070713d up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:40:16.718143 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port 468f0d50-535d-45b9-b22e-a7612070713d completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:40:16.721634 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port 468f0d50-535d-45b9-b22e-a7612070713d triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:40:16.722003 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:16.800150 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:16.822933 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:40:16.825185 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-382bde9f-a86b-41d0-9e62-15b5de425150" -d '{"events": [{"server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "name": "network-vif-plugged", "status": "completed", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:40:16.837469 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:40:16.841576 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:16.887710 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:16.984679 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:40:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-053cc60b-bc58-44ac-bb92-52e6981bd670 x-openstack-request-id: req-053cc60b-bc58-44ac-bb92-52e6981bd670 {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:40:16.985308 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "name": "network-vif-plugged", "status": "completed", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:40:16.985308 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-053cc60b-bc58-44ac-bb92-52e6981bd670 {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:40:16.985603 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'code': 200} Sep 16 16:40:17.141342 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc77532-9db8-46c6-ad2d-99f5726b1a9b req-bc53fb0f-6aec-4404-9637-4fb2962d348f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:17.143967 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bdc77532-9db8-46c6-ad2d-99f5726b1a9b req-bc53fb0f-6aec-4404-9637-4fb2962d348f service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1098 time: 0.0398965 Sep 16 16:40:17.178370 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bdc77532-9db8-46c6-ad2d-99f5726b1a9b req-f938d855-c242-40b5-9ef5-7febdfed8fca service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0267589 Sep 16 16:40:17.561659 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1084af2-3141-4c07-803f-029a7f9b83b7 req-09591ef9-0931-4157-a6bf-fc2496fc2736 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:17.563087 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d1084af2-3141-4c07-803f-029a7f9b83b7 req-09591ef9-0931-4157-a6bf-fc2496fc2736 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0466514 Sep 16 16:40:17.602267 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d1084af2-3141-4c07-803f-029a7f9b83b7 req-37d02e8d-154f-4e0a-b27e-e76864461bd2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333762 Sep 16 16:40:18.721517 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a26d9cd-f006-4267-83d0-e30b54694af2 req-86a2a98f-5a1f-49ea-8c1f-5fdca60e0edb tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:18.723489 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4a26d9cd-f006-4267-83d0-e30b54694af2 req-86a2a98f-5a1f-49ea-8c1f-5fdca60e0edb tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0567544 Sep 16 16:40:18.759508 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-4a26d9cd-f006-4267-83d0-e30b54694af2 req-6c53fd22-75ad-4511-93bc-da4ace56fdad tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301657 Sep 16 16:40:18.868610 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6db5482-5dae-4e55-a6fc-505b82de7aab req-71b80af1-2cee-4bcc-81bb-416ffa61b3e3 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:18.870043 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b6db5482-5dae-4e55-a6fc-505b82de7aab req-71b80af1-2cee-4bcc-81bb-416ffa61b3e3 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0474286 Sep 16 16:40:18.905768 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b6db5482-5dae-4e55-a6fc-505b82de7aab req-07d578f1-8faf-42b4-83e2-7eded2a4e133 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299628 Sep 16 16:40:19.216394 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63eb17e-d6db-4837-be7f-8fc14289855d req-122ec76f-5f3b-492d-8208-4ac4bbe19fd9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:19.217854 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c63eb17e-d6db-4837-be7f-8fc14289855d req-122ec76f-5f3b-492d-8208-4ac4bbe19fd9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0475338 Sep 16 16:40:19.253235 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c63eb17e-d6db-4837-be7f-8fc14289855d req-9fe03a48-8359-480b-8f5e-9628ac220a0d tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0295830 Sep 16 16:40:20.740130 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-84e70aa5-8ce6-4173-bbba-dc81c71ee6ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:23.450379 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-59dba798-5515-4de9-9581-cd9253e91fa0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:23.743387 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:24.441154 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:26.283439 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:27.587744 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7abc55-5f1b-45eb-b0d5-e349ca216ad3 req-aa6fbba1-f4ab-42a9-96bc-7f03303ddf17 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:27.589157 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7d7abc55-5f1b-45eb-b0d5-e349ca216ad3 req-aa6fbba1-f4ab-42a9-96bc-7f03303ddf17 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0469918 Sep 16 16:40:27.628801 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7d7abc55-5f1b-45eb-b0d5-e349ca216ad3 req-d79364d3-e267-429e-86ba-3fb57ee32705 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337784 Sep 16 16:40:27.650940 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45504) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:27.730398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f8bbc8e-c7ab-4bf5-ab39-1c1d2ecb538c tempest-TestMinimumBasicScenario-765982 tempest-TestMinimumBasicScenario-765982-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:27.731937 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-4f8bbc8e-c7ab-4bf5-ab39-1c1d2ecb538c tempest-TestMinimumBasicScenario-765982 tempest-TestMinimumBasicScenario-765982-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1093 time: 0.0799956 Sep 16 16:40:27.734694 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45508) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:27.739503 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'port_id': '468f0d50-535d-45b9-b22e-a7612070713d', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'fixed_ip_address': '172.20.0.5'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:27.760322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for floatingip, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:27.856430 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:27.953561 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Allocated IP 172.27.3.152 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/7e513b9a-4aae-4b7a-aa87-d86970a187bb) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:40:28.053270 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:28.085054 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:28.121545 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:40:28.124330 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:40:28.127662 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:40:28.134690 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'Port': ['ID=7e513b9a-4aae-4b7a-aa87-d86970a187bb,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:28.472853 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:28.535830 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:28.681637 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:28.685758 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:28.752491 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'Port': ['ID=7e513b9a-4aae-4b7a-aa87-d86970a187bb,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:28.764046 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.087125 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Floating IP bea9c44d-bf64-4063-b4d5-b6b41f38a121 associated. External IP: 172.27.3.152, port: 468f0d50-535d-45b9-b22e-a7612070713d. Sep 16 16:40:29.286379 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Router 75865ab2-4183-4e8a-beb5-a2ccba525741 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:40:29.390919 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:40:29.401172 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] Sync routers for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:40:29.406808 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.410130 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:40:29.410769 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:40:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:40:29.437045 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e9fed29f-16f7-4f63-bef6-83c19a7667a7 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7013133 Sep 16 16:40:29.437733 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:40:29.439895 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45510) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:29.440398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a1e0a6ad-9d2e-4587-90a5-f3b182607125" -d '{"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:40:29.445394 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-169735675', 'description': 'tempest-secgroup-smoke-169735675 description', 'project_id': '8b9df3c8324941d482822ccfbb50493d'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:29.468363 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.517265 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:40:29.534816 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:40:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8243465-5adb-4b51-9a9e-0e4be541c522 x-openstack-request-id: req-b8243465-5adb-4b51-9a9e-0e4be541c522 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:40:29.535106 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:40:29.535384 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-b8243465-5adb-4b51-9a9e-0e4be541c522 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:40:29.535778 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'status': 'completed', 'code': 200} Sep 16 16:40:29.561177 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.572127 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.622343 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.623564 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.1825447 Sep 16 16:40:29.626530 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45516) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:29.626763 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340bb344-dba0-441e-bb65-7f98d3a43e3b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroup': ['ID=001e4f96-e280-4722-a508-48151d59acad,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:29.631940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-0cd1db78-2c7d-4b19-8bcd-7e8c06309f30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:29.632307 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group_rule': {'security_group_id': '001e4f96-e280-4722-a508-48151d59acad', 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:29.633407 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-0cd1db78-2c7d-4b19-8bcd-7e8c06309f30 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1098 time: 0.0710392 Sep 16 16:40:29.662614 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.719385 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.724343 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.736282 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-0b669412-6c21-4512-adf2-f5ce4814f17e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:29.737778 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-0b669412-6c21-4512-adf2-f5ce4814f17e service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.0970113 Sep 16 16:40:29.745223 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46ccf2b3-8738-4130-96fa-ad41671fb578,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:29.747538 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.751168 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-adb93bfc-1350-43cb-8c5f-fc715b2745d9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1208837 Sep 16 16:40:29.752767 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45518) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:29.757737 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group_rule': {'security_group_id': '001e4f96-e280-4722-a508-48151d59acad', 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:29.792831 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.808016 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': 'bea9c44d-bf64-4063-b4d5-b6b41f38a121', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'floating_ip_address': '172.27.3.152', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'port_id': '468f0d50-535d-45b9-b22e-a7612070713d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'mac_address': 'fa:16:3e:78:9f:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:40:28Z', 'updated_at': '2021-09-16T16:40:28Z', 'revision_number': 0, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:40:29.809125 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-d939d70e-0cd0-4377-9dca-9c7f418ac239 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 999 time: 0.0635915 Sep 16 16:40:29.839718 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] Checking router: 75865ab2-4183-4e8a-beb5-a2ccba525741 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:40:29.853629 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:40:29.854551 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:40:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:40:29.861463 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-cc1e8b2a-423a-41a6-b588-df509e69f597 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:29.862802 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-cc1e8b2a-423a-41a6-b588-df509e69f597 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0455813 Sep 16 16:40:29.863170 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.867390 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.889251 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=177cda20-08c2-48e0-8cb2-f674d03c21a3,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:29.899571 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:29.903521 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45520) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:29.903717 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a8c7438e-cd45-4cfc-9392-9ff66b266257 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1493258 Sep 16 16:40:29.908589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group_rule': {'security_group_id': '001e4f96-e280-4722-a508-48151d59acad', 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:29.937651 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-1fb59667-37c5-4011-b00d-65965fa899c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:29.939141 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-1fb59667-37c5-4011-b00d-65965fa899c0 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0692947 Sep 16 16:40:29.945525 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.070837 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.074782 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-d7f50f05-a204-403d-8786-1e9a0cfc93c9 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263885 Sep 16 16:40:30.075820 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.077904 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:40:30.101927 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a9a6e889-e848-465c-a6fb-1f2e09d06d81,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:30.123233 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.124400 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-42f22791-5350-4ff1-8647-3e60b627bdee tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2197783 Sep 16 16:40:30.127157 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45522) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:30.132081 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group_rule': {'security_group_id': '001e4f96-e280-4722-a508-48151d59acad', 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:30.161141 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.189971 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a1e0a6ad-9d2e-4587-90a5-f3b182607125 req-4da3a1fb-1b4b-41f7-98fc-7c37006c4390 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1028738 Sep 16 16:40:30.227725 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.232446 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.250181 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d9e9ff6-124b-4761-8807-cc850e7edb17,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:30.257520 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.258307 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-94d4639f-a05b-4b3b-9079-bd0a7e14dc03 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1299534 Sep 16 16:40:30.261352 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45524) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:30.266419 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group_rule': {'security_group_id': '001e4f96-e280-4722-a508-48151d59acad', 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:30.290432 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.securitygroups_db [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Project 8b9df3c8324941d482822ccfbb50493d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 16 16:40:30.295266 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.335402 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': 'bea9c44d-bf64-4063-b4d5-b6b41f38a121', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'floating_ip_address': '172.27.3.152', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'port_id': '468f0d50-535d-45b9-b22e-a7612070713d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'mac_address': 'fa:16:3e:78:9f:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:40:28Z', 'updated_at': '2021-09-16T16:40:28Z', 'revision_number': 0, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:40:30.361860 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9140fd85-6f4e-4885-b18b-d78edb5f54d5 None None] The sync data for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi is: [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': 'bea9c44d-bf64-4063-b4d5-b6b41f38a121', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'floating_ip_address': '172.27.3.152', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'port_id': '468f0d50-535d-45b9-b22e-a7612070713d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'mac_address': 'fa:16:3e:78:9f:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:40:28Z', 'updated_at': '2021-09-16T16:40:28Z', 'revision_number': 0, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:40:30.364983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.374371 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.400813 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cb20f79-dc18-42f5-9133-dabeb69c980d,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:30.406324 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.410983 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2fee77d4-955e-4055-a8b5-42ce40a4f6e9 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1448069 Sep 16 16:40:30.410983 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45528) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:40:30.415260 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'security_group_rule': {'security_group_id': '001e4f96-e280-4722-a508-48151d59acad', 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:30.437942 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.securitygroups_db [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Project 8b9df3c8324941d482822ccfbb50493d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 16 16:40:30.443110 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.504484 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.508131 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.525574 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e716acf-1110-4dbe-b4f3-6b4aed35e3b4,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:30.535420 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.536615 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-837fefaa-b1fd-4f02-9ae4-2627b161a263 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1247816 Sep 16 16:40:30.564462 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f336049-a975-4211-a72e-59e1de5ab87a None None] New status for floating IP bea9c44d-bf64-4063-b4d5-b6b41f38a121: ACTIVE {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:40:30.615294 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-e8d29576-e982-4be7-bbc5-56cb74c42223 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-169735675&fields=id&tenant_id=8b9df3c8324941d482822ccfbb50493d HTTP/1.1" status: 200 len: 267 time: 0.0321212 Sep 16 16:40:30.666064 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-29a4a3ad-c1ca-424b-a0a1-629d09afdedc tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:30.667556 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-29a4a3ad-c1ca-424b-a0a1-629d09afdedc tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0466709 Sep 16 16:40:30.678933 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'port': {'security_groups': ['3b3f204f-d99f-476e-bd67-e9cfd4c76856', '001e4f96-e280-4722-a508-48151d59acad']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:40:30.744726 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.933108 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:40:30.961281 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.965738 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:30.978274 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['468f0d50-535d-45b9-b22e-a7612070713d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:40:31.007570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.008186 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:31.009551 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2429ee71-b51d-42cb-ae0f-5e195a5c4c10 req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "PUT /v2.0/ports/468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 981 time: 0.3355999 Sep 16 16:40:31.009984 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:40:31.012258 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2264ff94-8fa8-483c-b197-f1cd4fabee2e" -d '{"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:40:31.048420 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a70c1201-2c83-4263-af64-5ce69f67f1c2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=6']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:40:31.079068 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['468f0d50-535d-45b9-b22e-a7612070713d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:40:31.086738 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:40:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fae26867-4093-4946-9797-8d62b60ab4dd x-openstack-request-id: req-fae26867-4093-4946-9797-8d62b60ab4dd {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:40:31.087125 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:40:31.087662 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-fae26867-4093-4946-9797-8d62b60ab4dd {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:40:31.088248 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'status': 'completed', 'code': 200} Sep 16 16:40:31.179039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-53b27671-6bab-4d1b-974e-4a9afe33315e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.180592 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-53b27671-6bab-4d1b-974e-4a9afe33315e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1137 time: 0.0820982 Sep 16 16:40:31.191801 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3de206-360a-45ab-bfbd-f205e21fc4fe req-d9fba3b7-0677-413b-b9ce-fe36d37f9056 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.193273 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6a3de206-360a-45ab-bfbd-f205e21fc4fe req-d9fba3b7-0677-413b-b9ce-fe36d37f9056 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0934529 Sep 16 16:40:31.283677 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6a3de206-360a-45ab-bfbd-f205e21fc4fe req-b6320afa-64b3-427c-8c1e-5b28989c4b3e tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0820782 Sep 16 16:40:31.288074 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-079a4fa6-7cc4-4335-b7b3-c0618ef97d00 None None] Provisioning complete for port 468f0d50-535d-45b9-b22e-a7612070713d triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:40:31.288449 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-079a4fa6-7cc4-4335-b7b3-c0618ef97d00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:31.308205 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-8d57d0ab-01f7-4dac-a31e-65e474996e29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.309634 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-8d57d0ab-01f7-4dac-a31e-65e474996e29 service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.1155078 Sep 16 16:40:31.373128 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-e4ca256e-095c-490d-8867-17a978ec5e8b service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 1001 time: 0.0556951 Sep 16 16:40:31.419693 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-959dd2b4-6544-4664-9385-703edc1089d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.421109 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-959dd2b4-6544-4664-9385-703edc1089d6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0413809 Sep 16 16:40:31.473483 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-62c0dd5b-2a34-4ec6-b183-446214000aea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.474960 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-62c0dd5b-2a34-4ec6-b183-446214000aea service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0465102 Sep 16 16:40:31.564157 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-f29f0322-bde6-4a63-bd44-56b643daacc4 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805852 Sep 16 16:40:31.656534 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2264ff94-8fa8-483c-b197-f1cd4fabee2e req-0bd4d102-9667-426a-8974-dbcb4394d8f0 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857313 Sep 16 16:40:31.781295 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8c0eea54-998c-4b51-8ba0-d583edea82de req-7dcb6e58-cb9e-447b-88a1-c3132866ee22 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0252664 Sep 16 16:40:31.846892 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8c0eea54-998c-4b51-8ba0-d583edea82de req-618767a8-dcd3-4ef1-a0ef-efe79ce64a9d service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0245411 Sep 16 16:40:31.884907 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8c0eea54-998c-4b51-8ba0-d583edea82de req-fde199f2-f358-4b3f-af3b-3dfd2ac2c7d0 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0185907 Sep 16 16:40:31.977414 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c0eea54-998c-4b51-8ba0-d583edea82de req-9723528a-29d3-4e12-8e20-6a7f02fa26a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:31.978806 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8c0eea54-998c-4b51-8ba0-d583edea82de req-9723528a-29d3-4e12-8e20-6a7f02fa26a4 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0873933 Sep 16 16:40:41.188527 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-02a4bf2e-e041-4282-b046-e6f173d2421a req-21f2541c-7eea-46e3-a5b8-334b2c62dd88 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] (93950) timed out ('10.222.0.59', 41606) {{(pid=93950) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 16 16:40:45.913202 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:49.359118 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-a598085a-0a12-41f5-8b44-c3870e9e1c1f req-76c595e0-0fbc-45dc-a55e-ffd1cea3ab96 service neutron] (93950) timed out ('10.222.0.66', 56936) {{(pid=93950) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 16 16:40:49.925340 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-4314e950-5629-46d6-939e-491e695a6608 req-55bf7036-0b42-449f-bd0a-0d8a65aef3a1 tempest-AttachVolumeShelveTestJSON-806254914 tempest-AttachVolumeShelveTestJSON-806254914-project] (93950) timed out ('10.222.0.59', 41312) {{(pid=93950) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 16 16:40:50.740794 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-fdc8931b-fdc6-4eb5-8eda-c62f098d2bce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:52.028797 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:40:53.454454 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e467888d-43d3-410f-936e-aa4acc43d30b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:53.743943 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:54.200072 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cdb5a5-d1d7-47d6-afa5-73fdb2e01240 req-06f5538c-8c91-4536-b6a6-f06d9708b7b2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:54.201608 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-10cdb5a5-d1d7-47d6-afa5-73fdb2e01240 req-06f5538c-8c91-4536-b6a6-f06d9708b7b2 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0778592 Sep 16 16:40:54.216748 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-da707083-1456-4060-8256-b1f8e55ca459 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:54.218182 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-da707083-1456-4060-8256-b1f8e55ca459 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1137 time: 0.0811536 Sep 16 16:40:54.273453 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-10cdb5a5-d1d7-47d6-afa5-73fdb2e01240 req-a209a00d-3501-4471-a49b-c3df499ea259 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0640395 Sep 16 16:40:54.325953 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-c1306095-4487-4f72-90fb-9e55517c96dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:54.327418 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-c1306095-4487-4f72-90fb-9e55517c96dc service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.1014581 Sep 16 16:40:54.390411 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-971aebbe-0c2f-449c-a481-31892c1fe3ed service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 1001 time: 0.0549634 Sep 16 16:40:54.442464 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-1f3531d0-96aa-4f50-91bf-e66a61072548 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:54.444201 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:54.444375 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-1f3531d0-96aa-4f50-91bf-e66a61072548 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0457344 Sep 16 16:40:54.490782 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-6eb05937-b89b-41bd-b6a4-6522fbf8dc64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:54.492270 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-6eb05937-b89b-41bd-b6a4-6522fbf8dc64 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0403934 Sep 16 16:40:54.579331 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-81feea82-a906-4cc6-8e52-ba7398ae2646 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784459 Sep 16 16:40:54.668014 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a7f9acb1-1aa7-461d-ab6b-1f6998dd20f4 req-12059774-c461-4b05-b86a-091c5bde5715 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812299 Sep 16 16:40:55.391630 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8af7ee-8f9a-4fa8-b5cd-6dc6a0381ca0 req-c54bdec4-5851-47e1-928d-4ad84ba959a8 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:55.393106 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8a8af7ee-8f9a-4fa8-b5cd-6dc6a0381ca0 req-c54bdec4-5851-47e1-928d-4ad84ba959a8 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0510762 Sep 16 16:40:55.432616 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8a8af7ee-8f9a-4fa8-b5cd-6dc6a0381ca0 req-751917db-dd61-42e4-8144-ac70273d6ed5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0328639 Sep 16 16:40:56.255951 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:40:56.549935 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188f717c-9ab2-4c99-a44b-c3842fd92a4a req-b261a27d-baff-4ba2-96b5-7602d91459dd tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:56.551936 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-188f717c-9ab2-4c99-a44b-c3842fd92a4a req-b261a27d-baff-4ba2-96b5-7602d91459dd tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0479126 Sep 16 16:40:56.590453 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-188f717c-9ab2-4c99-a44b-c3842fd92a4a req-31b4278e-550c-4547-a17a-2db6e80ac630 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0324416 Sep 16 16:40:57.701571 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1281c9b-7fcf-45fd-8438-4dbd53f2b617 req-320456b7-e72a-4d0b-826f-3c2feb72d878 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:57.703024 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a1281c9b-7fcf-45fd-8438-4dbd53f2b617 req-320456b7-e72a-4d0b-826f-3c2feb72d878 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0475419 Sep 16 16:40:57.741586 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-a1281c9b-7fcf-45fd-8438-4dbd53f2b617 req-b408fd92-0814-4faf-a561-b6ef5d11f1af tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0316970 Sep 16 16:40:59.099754 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db31650-379c-484b-8a3c-dc59ad5b9229 req-ee804921-a3bf-40bd-b54b-94f6c96e0d91 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:40:59.101120 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1db31650-379c-484b-8a3c-dc59ad5b9229 req-ee804921-a3bf-40bd-b54b-94f6c96e0d91 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.2944975 Sep 16 16:40:59.138679 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-1db31650-379c-484b-8a3c-dc59ad5b9229 req-2f79e040-62aa-44cb-a770-d167e1784a58 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0315526 Sep 16 16:41:00.250886 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97185cb9-d2e1-4abf-b9ef-8eea4d74c33f req-41c2710e-b2b3-4d3a-817d-a9c45dc8a1af tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:00.252377 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-97185cb9-d2e1-4abf-b9ef-8eea4d74c33f req-41c2710e-b2b3-4d3a-817d-a9c45dc8a1af tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0483649 Sep 16 16:41:00.290654 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-97185cb9-d2e1-4abf-b9ef-8eea4d74c33f req-c5e28ad4-21bf-48b8-b504-0071eb980fa6 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0324144 Sep 16 16:41:01.400408 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dcd98ef-9f46-4b4f-9d03-d6d21d81e93b req-08b10111-7350-4394-94e0-09f2ff8b2d23 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:01.401814 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3dcd98ef-9f46-4b4f-9d03-d6d21d81e93b req-08b10111-7350-4394-94e0-09f2ff8b2d23 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0462189 Sep 16 16:41:01.440137 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3dcd98ef-9f46-4b4f-9d03-d6d21d81e93b req-0b8dc58c-a30a-4ae4-9a9f-d30b7c1b228c tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0323710 Sep 16 16:41:02.557664 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba8b9cb-8493-46f9-9c57-16537e4f063b req-7609a044-bea3-4706-b878-f21af619b210 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:02.559146 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9ba8b9cb-8493-46f9-9c57-16537e4f063b req-7609a044-bea3-4706-b878-f21af619b210 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0519683 Sep 16 16:41:02.604231 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-9ba8b9cb-8493-46f9-9c57-16537e4f063b req-d6c8b67b-27f8-47bd-82f6-41eba0dfc6e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0390038 Sep 16 16:41:03.714158 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10540690-802d-4e6c-a686-566a86149fef req-bd0cf0d1-32ed-4301-8ec5-494734513914 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:03.715601 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-10540690-802d-4e6c-a686-566a86149fef req-bd0cf0d1-32ed-4301-8ec5-494734513914 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0465920 Sep 16 16:41:03.753353 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-10540690-802d-4e6c-a686-566a86149fef req-6221b921-5381-4a30-9d74-94048fcdeb0b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0319870 Sep 16 16:41:04.870051 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4eca259-93a5-450b-9d66-1737f67d5316 req-78bb7047-91fb-463b-9653-1f656b38f902 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:04.871531 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e4eca259-93a5-450b-9d66-1737f67d5316 req-78bb7047-91fb-463b-9653-1f656b38f902 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0483131 Sep 16 16:41:04.910534 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e4eca259-93a5-450b-9d66-1737f67d5316 req-adcd361a-f4c0-4f25-bc02-c281357243a6 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0329237 Sep 16 16:41:06.023437 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12e9a1d-1a87-4460-a42f-8e4f8e81da96 req-3588a696-948c-4de0-b16b-4f3e4592d253 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:06.024871 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a12e9a1d-1a87-4460-a42f-8e4f8e81da96 req-3588a696-948c-4de0-b16b-4f3e4592d253 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0506098 Sep 16 16:41:06.063162 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a12e9a1d-1a87-4460-a42f-8e4f8e81da96 req-46bb3640-ec55-49e4-a6d1-0ce877d07a7b tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0323741 Sep 16 16:41:07.184220 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc33a30-a6a6-4963-a29e-45dd193cad2b req-17c7da30-1ce0-4efe-9286-25f50e5f90f8 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:07.185713 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2cc33a30-a6a6-4963-a29e-45dd193cad2b req-17c7da30-1ce0-4efe-9286-25f50e5f90f8 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0492766 Sep 16 16:41:07.224653 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2cc33a30-a6a6-4963-a29e-45dd193cad2b req-3a6c0235-1c14-4f95-a629-dcfb5c8d1835 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0331023 Sep 16 16:41:08.335488 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7799090-985b-4c06-8c41-3b94bed180c0 req-47038ea4-5c10-4ad9-8bb1-016cfa010f57 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:08.336930 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7799090-985b-4c06-8c41-3b94bed180c0 req-47038ea4-5c10-4ad9-8bb1-016cfa010f57 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0466135 Sep 16 16:41:08.375311 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7799090-985b-4c06-8c41-3b94bed180c0 req-8dd071b7-6086-4da5-8204-8b0fb70bde1e tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0324318 Sep 16 16:41:09.492098 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b51691-3c17-4737-a531-daf19ffcc99c req-17901313-f5e9-4477-b4f5-2b4ca895d0d5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:09.493501 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d4b51691-3c17-4737-a531-daf19ffcc99c req-17901313-f5e9-4477-b4f5-2b4ca895d0d5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0536208 Sep 16 16:41:09.531610 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d4b51691-3c17-4737-a531-daf19ffcc99c req-77f74302-da94-450c-b782-5612130c7a16 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0322046 Sep 16 16:41:10.642640 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a83520c-d612-4ba5-8ff5-339d04da5f8a req-382964b2-ef44-4529-9bc9-0d8b74a630e3 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:10.644610 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a83520c-d612-4ba5-8ff5-339d04da5f8a req-382964b2-ef44-4529-9bc9-0d8b74a630e3 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0468721 Sep 16 16:41:10.682711 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0a83520c-d612-4ba5-8ff5-339d04da5f8a req-53dc9e0f-5fdc-4c6c-bb48-25cb3791ec92 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&id=001e4f96-e280-4722-a508-48151d59acad&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0323112 Sep 16 16:41:15.939518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:20.740505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-148791ce-a8ed-4307-8437-e4e84bd6762a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:23.454333 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-bd3152ea-43a8-4469-80fa-a323ae0a4ecc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:23.743117 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:24.446895 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:26.258469 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:29.028233 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:41:31.595762 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-bd311a73-dd92-44fe-b404-8503ff863d9d service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0413263 Sep 16 16:41:31.655103 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0a3010-e653-4772-a516-8f3393886cfb req-4e265e28-7585-464f-86bc-8d89cd95a49a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:31.656553 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-4e265e28-7585-464f-86bc-8d89cd95a49a service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1137 time: 0.0385206 Sep 16 16:41:31.759803 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0a3010-e653-4772-a516-8f3393886cfb req-686f1115-80c6-45d0-beb3-f0e6851eb934 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:31.761243 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-686f1115-80c6-45d0-beb3-f0e6851eb934 service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.0835495 Sep 16 16:41:31.829638 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-1dce9e4f-75d9-4cc1-afe5-5c138fba8862 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 1001 time: 0.0610058 Sep 16 16:41:31.876242 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0a3010-e653-4772-a516-8f3393886cfb req-a5d8ae92-9d15-48cd-8ddc-d87750f24b38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:31.877528 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-a5d8ae92-9d15-48cd-8ddc-d87750f24b38 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0408144 Sep 16 16:41:31.921271 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0a3010-e653-4772-a516-8f3393886cfb req-2f01c52c-63da-4940-9b20-7b513b687d5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:31.922683 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-2f01c52c-63da-4940-9b20-7b513b687d5a service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0375466 Sep 16 16:41:32.011789 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-a3847980-d685-4444-8103-f05a28a02322 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815406 Sep 16 16:41:32.102091 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-df0a3010-e653-4772-a516-8f3393886cfb req-a5c5d68d-6a03-45b3-953c-c382a1979f53 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816610 Sep 16 16:41:43.174924 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-5fb31084-19d0-4545-b3c9-a2d690e8c342 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-169735675&fields=id&tenant_id=8b9df3c8324941d482822ccfbb50493d HTTP/1.1" status: 200 len: 267 time: 0.0368655 Sep 16 16:41:43.230685 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-59acad0b-98af-49a5-855b-e37061bdf5dd tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:43.232210 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-59acad0b-98af-49a5-855b-e37061bdf5dd tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 984 time: 0.0517178 Sep 16 16:41:43.242958 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Request body: {'port': {'security_groups': ['3b3f204f-d99f-476e-bd67-e9cfd4c76856']}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:41:43.307381 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.475129 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:43.504210 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.508616 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.520921 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['468f0d50-535d-45b9-b22e-a7612070713d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:41:43.553728 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:43.554373 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.555824 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ebe0a407-ef05-43e1-896b-b60e077c7147 req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "PUT /v2.0/ports/468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 942 time: 0.3172245 Sep 16 16:41:43.556549 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:41:43.561891 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-febe7d77-6743-4622-877f-904aa8d53671" -d '{"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:41:43.562750 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45588) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:43.581100 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event updated for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=7']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:43.588663 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.589022 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.589368 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.589709 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.590047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.590384 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.590720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.591056 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.591428 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.591758 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.592085 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.592411 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0998381-b6ac-4822-93a0-b3eb1fd35c05 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.616075 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:41:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37768b23-5d80-407d-9778-2b45f680555c x-openstack-request-id: req-37768b23-5d80-407d-9778-2b45f680555c {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:41:43.616567 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:41:43.616986 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-37768b23-5d80-407d-9778-2b45f680555c {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:41:43.617552 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'status': 'completed', 'code': 200} Sep 16 16:41:43.635668 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['468f0d50-535d-45b9-b22e-a7612070713d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:41:43.672790 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.709411 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.718395 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febe7d77-6743-4622-877f-904aa8d53671 req-2183105f-e87d-4b6b-88a9-85316fd1c135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:43.719919 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-2183105f-e87d-4b6b-88a9-85316fd1c135 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1098 time: 0.0775459 Sep 16 16:41:43.786294 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-5f615173-f23e-4f66-8004-3e082565b4e6 None None] Provisioning complete for port 468f0d50-535d-45b9-b22e-a7612070713d triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:41:43.786643 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5f615173-f23e-4f66-8004-3e082565b4e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.833458 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febe7d77-6743-4622-877f-904aa8d53671 req-f60eea29-65bb-4408-ae7a-0d2cd35d5758 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:43.834845 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-f60eea29-65bb-4408-ae7a-0d2cd35d5758 service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.1050744 Sep 16 16:41:43.849281 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.851758 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:43.852817 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "DELETE /v2.0/security-groups/001e4f96-e280-4722-a508-48151d59acad HTTP/1.1" status: 204 len: 168 time: 0.2895751 Sep 16 16:41:43.857124 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45590) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:43.889255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=001e4f96-e280-4722-a508-48151d59acad,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:43.900680 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.901049 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.901377 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.901711 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.902045 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.902376 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.902701 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.903028 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.903378 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.903701 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.904022 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.904378 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ceefcfa-7572-4c58-a3cd-1f94ee34b4e0 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:41:43.923559 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-636ae061-d0f5-4111-b656-fae34a6cccc9 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 1001 time: 0.0815301 Sep 16 16:41:43.976584 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febe7d77-6743-4622-877f-904aa8d53671 req-a8af8338-093b-4bb3-9fce-145970616cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:43.978036 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-a8af8338-093b-4bb3-9fce-145970616cf8 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0475783 Sep 16 16:41:44.018618 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Deleting port 7e513b9a-4aae-4b7a-aa87-d86970a187bb {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:44.018880 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:44.024415 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febe7d77-6743-4622-877f-904aa8d53671 req-1a1e630f-0f6c-46a6-8435-c05c147a7310 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:44.025916 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-1a1e630f-0f6c-46a6-8435-c05c147a7310 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0394421 Sep 16 16:41:44.095886 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:44.096367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:44.108340 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Calling delete_port for 7e513b9a-4aae-4b7a-aa87-d86970a187bb owned by network:floatingip {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:44.113594 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-840133b4-e271-406c-ae8e-0ca82f5a7bd2 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798576 Sep 16 16:41:44.202283 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-febe7d77-6743-4622-877f-904aa8d53671 req-4000d945-6103-41b6-8966-d7bf8b42b0cb service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821261 Sep 16 16:41:44.277927 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:44.303815 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event deleted for resources: {'Port': ['ID=7e513b9a-4aae-4b7a-aa87-d86970a187bb,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:44.359445 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks [] for floatingip, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:44.359777 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Floating IP bea9c44d-bf64-4063-b4d5-b6b41f38a121 disassociated (deleted). External IP: 172.27.3.152, port: 468f0d50-535d-45b9-b22e-a7612070713d. Sep 16 16:41:44.556500 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Router 75865ab2-4183-4e8a-beb5-a2ccba525741 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:41:44.662002 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:41:44.666482 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:44.672002 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] Sync routers for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:41:44.681560 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:41:44.682169 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:44.692801 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-76f0f97b-106c-456b-b306-d3eceb066ba5 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "DELETE /v2.0/floatingips/bea9c44d-bf64-4063-b4d5-b6b41f38a121 HTTP/1.1" status: 204 len: 168 time: 0.8360555 Sep 16 16:41:44.786120 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:41:44.984660 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:45.010011 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] Checking router: 75865ab2-4183-4e8a-beb5-a2ccba525741 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:41:45.017932 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:41:45.018525 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:45.119406 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:41:45.311021 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:45.336608 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af56b710-e0a9-4db8-af83-bf219f707251 None None] The sync data for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi is: [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:39:44Z', 'revision_number': 4, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '61fa556e-7662-4fc1-ab31-b6142b80b477', 'name': '', 'network_id': '5b1e1b97-8da3-4734-a096-dcc18d4c91f6', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'mac_address': 'fa:16:3e:1c:09:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:43Z', 'updated_at': '2021-09-16T16:39:48Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'subnets': [{'id': 'ae0084a1-dbaa-404c-a430-61ff268bd88f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:41:45.533084 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b1e8ea8-69cb-4e92-b284-791e3c85918c None None] New status for floating IP bea9c44d-bf64-4063-b4d5-b6b41f38a121: DOWN {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:41:45.619569 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:41:45.622595 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83e078ed-6400-4116-afa6-5b0e64a92ce4" -d '{"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:41:45.658728 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:41:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09f53016-311d-4412-a337-73e04220adcf x-openstack-request-id: req-09f53016-311d-4412-a337-73e04220adcf {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:41:45.659018 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:41:45.659317 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-09f53016-311d-4412-a337-73e04220adcf {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:41:45.659748 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'status': 'completed', 'code': 200} Sep 16 16:41:45.720685 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-c9a0db22-8836-4ece-91e7-a833240ee6d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:45.722154 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-c9a0db22-8836-4ece-91e7-a833240ee6d0 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=8b9df3c8324941d482822ccfbb50493d&device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 1098 time: 0.0410323 Sep 16 16:41:45.817500 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-98497844-158b-4434-908e-7986203c99f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:45.818969 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-98497844-158b-4434-908e-7986203c99f3 service neutron] 10.222.0.66 "GET /v2.0/networks?id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 200 len: 915 time: 0.0901523 Sep 16 16:41:45.858815 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-e893597d-9d2e-43db-ab44-1cabedf8769f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 200 len: 217 time: 0.0325415 Sep 16 16:41:45.905534 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-0e90c5ae-6da2-4509-af12-1d9b6e7a8d81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:45.906821 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-0e90c5ae-6da2-4509-af12-1d9b6e7a8d81 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 200 len: 853 time: 0.0416799 Sep 16 16:41:45.947007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:45.956326 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-f12dc441-a34e-4979-82d1-0ae1ea48fa37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:45.957861 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-f12dc441-a34e-4979-82d1-0ae1ea48fa37 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=5b1e1b97-8da3-4734-a096-dcc18d4c91f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0439353 Sep 16 16:41:46.045745 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-4254b33f-f2f1-49df-a1a2-5ae9bedd27aa service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803683 Sep 16 16:41:46.144272 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-83e078ed-6400-4116-afa6-5b0e64a92ce4 req-354fa12f-7532-41df-9e51-46b5f1235231 service neutron] 10.222.0.66 "GET /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917683 Sep 16 16:41:47.395610 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a91424-ef12-4b67-b12a-bc2ccfbbb815 req-2684e3a5-8973-478f-b8c4-7430d06d0f3a tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:47.397064 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b8a91424-ef12-4b67-b12a-bc2ccfbbb815 req-2684e3a5-8973-478f-b8c4-7430d06d0f3a tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0467861 Sep 16 16:41:47.433282 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b8a91424-ef12-4b67-b12a-bc2ccfbbb815 req-e2dff0e1-27c8-4de8-bd57-c1b32098c2a3 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303540 Sep 16 16:41:48.552206 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58077385-bcca-4fb6-a7ae-449b8a03c044 req-6770b033-142c-4311-9fbc-aa7164c606df tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:48.553669 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58077385-bcca-4fb6-a7ae-449b8a03c044 req-6770b033-142c-4311-9fbc-aa7164c606df tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0482023 Sep 16 16:41:48.589404 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-58077385-bcca-4fb6-a7ae-449b8a03c044 req-d8c3dd90-02a1-49ce-909e-27d75ab9254f tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/security-groups?id=3b3f204f-d99f-476e-bd67-e9cfd4c76856&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0297005 Sep 16 16:41:49.026971 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-4a0dc3b5-4ba6-4de1-a799-91a20b57c3ff tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:49.028412 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-4a0dc3b5-4ba6-4de1-a799-91a20b57c3ff tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.66 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 945 time: 0.0460258 Sep 16 16:41:49.117175 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Deleting port 468f0d50-535d-45b9-b22e-a7612070713d {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:49.117511 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:49.202216 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] For port 468f0d50-535d-45b9-b22e-a7612070713d, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=468f0d50-535d-45b9-b22e-a7612070713d,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:49.202577 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:49.215445 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Calling delete_port for 468f0d50-535d-45b9-b22e-a7612070713d owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:49.339626 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:49.350985 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['468f0d50-535d-45b9-b22e-a7612070713d'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:41:49.375898 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Pushing event deleted for resources: {'Port': ['ID=468f0d50-535d-45b9-b22e-a7612070713d,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:49.413797 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] No DVR routers for this DVR port 468f0d50-535d-45b9-b22e-a7612070713d on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:41:49.416415 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:49.418410 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8b2e8860-a17a-4332-bc75-be721fb1630f req-5d02e4ee-d13a-4749-8799-8de71214fffe tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.66 "DELETE /v2.0/ports/468f0d50-535d-45b9-b22e-a7612070713d HTTP/1.1" status: 204 len: 173 time: 0.3836627 Sep 16 16:41:49.418874 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'name': 'network-vif-deleted', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:41:49.421215 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c35efb00-65e5-4f83-ba3f-10294de9fd49" -d '{"events": [{"server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "name": "network-vif-deleted", "tag": "468f0d50-535d-45b9-b22e-a7612070713d"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:41:49.457015 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:41:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-068a7d28-b8a5-4e45-83c0-c6ad91da756e x-openstack-request-id: req-068a7d28-b8a5-4e45-83c0-c6ad91da756e {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:41:49.457314 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66b68513-32ee-4477-b48e-bb5a03b68adb", "name": "network-vif-deleted", "tag": "468f0d50-535d-45b9-b22e-a7612070713d", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:41:49.457567 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-068a7d28-b8a5-4e45-83c0-c6ad91da756e {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:41:49.457980 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66b68513-32ee-4477-b48e-bb5a03b68adb', 'name': 'network-vif-deleted', 'tag': '468f0d50-535d-45b9-b22e-a7612070713d', 'status': 'completed', 'code': 200} Sep 16 16:41:49.691416 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6fe3095c-2a96-46a7-9da7-6af4cdcb81fb req-b3c4da5b-d9c7-4573-b70e-e89e13378f17 tempest-TestMinimumBasicScenario-800802799 tempest-TestMinimumBasicScenario-800802799-project] 10.222.0.59 "GET /v2.0/ports?device_id=66b68513-32ee-4477-b48e-bb5a03b68adb HTTP/1.1" status: 200 len: 210 time: 0.0259097 Sep 16 16:41:50.740910 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-76254533-1566-49e2-8ea8-809ddc19f68b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:51.234687 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45678) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:51.564819 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:51.796479 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Deleting port 61fa556e-7662-4fc1-ab31-b6142b80b477 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:51.796810 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:51.871902 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] For port 61fa556e-7662-4fc1-ab31-b6142b80b477, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=61fa556e-7662-4fc1-ab31-b6142b80b477,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:51.872206 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:51.887132 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Calling delete_port for 61fa556e-7662-4fc1-ab31-b6142b80b477 owned by network:router_interface {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:52.058653 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:52.084018 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=61fa556e-7662-4fc1-ab31-b6142b80b477,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:52.248714 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:52.684090 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Router 75865ab2-4183-4e8a-beb5-a2ccba525741 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:41:52.785481 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:41:52.790484 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-cb48bfa5-4b58-4000-b70e-9db90427a2c5 admin admin] 10.222.0.59 "PUT /v2.0/routers/75865ab2-4183-4e8a-beb5-a2ccba525741/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5548179 Sep 16 16:41:52.793102 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45680) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:52.796449 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] Sync routers for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:41:52.806671 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:41:52.807392 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:52.894180 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks [] for router, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:52.908034 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:41:52.994780 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.044330 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Deleting port 24e0873b-9da9-49d9-adc3-e64d3d354616 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:53.044665 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.083363 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247'}], 'enable_snat': True}, 'gw_port_id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:41:52Z', 'revision_number': 5, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port': {'id': '24e0873b-9da9-49d9-adc3-e64d3d354616', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:bc:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:42Z', 'updated_at': '2021-09-16T16:39:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:53.121955 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] For port 24e0873b-9da9-49d9-adc3-e64d3d354616, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=24e0873b-9da9-49d9-adc3-e64d3d354616,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:53.122341 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.135946 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Calling delete_port for 24e0873b-9da9-49d9-adc3-e64d3d354616 owned by network:router_gateway {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:53.233524 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 468f0d50-535d-45b9-b22e-a7612070713d no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:53.235851 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] Checking router: 75865ab2-4183-4e8a-beb5-a2ccba525741 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:41:53.256437 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: 468f0d50-535d-45b9-b22e-a7612070713d {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:53.256741 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 468f0d50-535d-45b9-b22e-a7612070713d not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:53.262375 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] Routers {'75865ab2-4183-4e8a-beb5-a2ccba525741'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:41:53.262987 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['75865ab2-4183-4e8a-beb5-a2ccba525741'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:53.303960 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.333615 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Pushing event deleted for resources: {'Port': ['ID=24e0873b-9da9-49d9-adc3-e64d3d354616,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:53.347643 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] Set router 75865ab2-4183-4e8a-beb5-a2ccba525741 gateway port host: None {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:41:53.394520 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.406014 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:41:52Z', 'revision_number': 6, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:53.435321 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6727d700-3f57-42b3-ae01-63c9e0dd70dc None None] The sync data for ids ['75865ab2-4183-4e8a-beb5-a2ccba525741'] in dv-cinder-805887-15-iscsi is: [{'id': '75865ab2-4183-4e8a-beb5-a2ccba525741', 'name': 'tempest-TestMinimumBasicScenario-908423069-router', 'tenant_id': '8b9df3c8324941d482822ccfbb50493d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:41Z', 'updated_at': '2021-09-16T16:41:52Z', 'revision_number': 6, 'project_id': '8b9df3c8324941d482822ccfbb50493d', 'gw_port_host': None}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:41:53.456803 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-bb935c45-ed53-4212-97b5-b267895ca41f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.489494 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.491575 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.538894 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.539423 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 75865ab2-4183-4e8a-beb5-a2ccba525741 {{(pid=93950) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:41:53.544561 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.545709 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0c36e1f3-5cbb-4b72-af51-f07cdd12ec54 admin admin] 10.222.0.59 "DELETE /v2.0/routers/75865ab2-4183-4e8a-beb5-a2ccba525741 HTTP/1.1" status: 204 len: 168 time: 0.7517078 Sep 16 16:41:53.548287 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45682) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:53.591030 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Deleting subnet ae0084a1-dbaa-404c-a430-61ff268bd88f {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:41:53.593916 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.627386 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.704328 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.742946 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.759463 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.792453 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae0084a1-dbaa-404c-a430-61ff268bd88f,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:53.796089 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.800915 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45684) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:53.802156 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-0344cc0c-7502-4d04-ba73-ff21b7b1eece admin admin] 10.222.0.59 "DELETE /v2.0/subnets/ae0084a1-dbaa-404c-a430-61ff268bd88f HTTP/1.1" status: 204 len: 168 time: 0.2504401 Sep 16 16:41:53.802822 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e15fa733-e736-4d21-9246-83b6f3602502 None None] Network 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:41:53.872843 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.932924 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Deleting port 491a1093-71aa-47a5-936a-f29926efe34c {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:53.933255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:53.993180 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] For port 491a1093-71aa-47a5-936a-f29926efe34c, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=491a1093-71aa-47a5-936a-f29926efe34c,segment=NetworkSegment(2065031c-0eec-4fd2-9ec0-667b568e60f5),segment_id=2065031c-0eec-4fd2-9ec0-667b568e60f5)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:53.993559 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.005039 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Calling delete_port for 491a1093-71aa-47a5-936a-f29926efe34c owned by network:dhcp {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:54.082096 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.107067 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Pushing event deleted for resources: {'Port': ['ID=491a1093-71aa-47a5-936a-f29926efe34c,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:54.110711 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] No DVR routers for this DVR port 491a1093-71aa-47a5-936a-f29926efe34c on host dv-cinder-805887-15-iscsi {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:41:54.184839 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.204586 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5b1e1b97-8da3-4734-a096-dcc18d4c91f6']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:54.210352 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e360d30-10f6-4c72-a72d-881a961e4983 None None] DHCP port deletion for 5b1e1b97-8da3-4734-a096-dcc18d4c91f6 request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:41:54.225894 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2065031c-0eec-4fd2-9ec0-667b568e60f5') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:54.225894 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2065031c-0eec-4fd2-9ec0-667b568e60f5') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:54.231982 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.245553 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.251620 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Releasing vlan 747 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:41:54.252078 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:41:54.253951 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:41:54.288058 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24e0873b-9da9-49d9-adc3-e64d3d354616 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:54.311511 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 24e0873b-9da9-49d9-adc3-e64d3d354616 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:54.311958 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24e0873b-9da9-49d9-adc3-e64d3d354616 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:54.312438 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 61fa556e-7662-4fc1-ab31-b6142b80b477 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:54.315506 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.321017 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.325918 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] 10.222.0.59 "DELETE /v2.0/networks/5b1e1b97-8da3-4734-a096-dcc18d4c91f6 HTTP/1.1" status: 204 len: 168 time: 0.5189404 Sep 16 16:41:54.325918 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45686) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:54.332232 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 61fa556e-7662-4fc1-ab31-b6142b80b477 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:54.332515 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 61fa556e-7662-4fc1-ab31-b6142b80b477 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:54.332926 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 491a1093-71aa-47a5-936a-f29926efe34c no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:54.340757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f339a4-77c9-4e52-8e05-16270900c5da admin admin] Pushing event deleted for resources: {'Network': ['ID=5b1e1b97-8da3-4734-a096-dcc18d4c91f6,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:54.354872 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 491a1093-71aa-47a5-936a-f29926efe34c {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:54.355259 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 491a1093-71aa-47a5-936a-f29926efe34c not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:54.452781 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.672369 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.904215 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Deleting port 9ed0a2bb-0c19-4de4-b539-4815562e72f4 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:54.904880 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.978187 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] For port 9ed0a2bb-0c19-4de4-b539-4815562e72f4, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=9ed0a2bb-0c19-4de4-b539-4815562e72f4,segment=NetworkSegment(c61b3e3c-5a37-485c-a517-77e7bc7bf973),segment_id=c61b3e3c-5a37-485c-a517-77e7bc7bf973)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:54.978575 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:54.990868 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Calling delete_port for 9ed0a2bb-0c19-4de4-b539-4815562e72f4 owned by network:router_interface {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:55.161142 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:55.190735 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Pushing event deleted for resources: {'Port': ['ID=9ed0a2bb-0c19-4de4-b539-4815562e72f4,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:55.346571 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:55.550054 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Router b58ec9d8-89ba-4ea4-9df3-441a86c90754 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:41:55.895279 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:41:55.900135 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1a02f24c-330d-4635-852d-de0eb700f080 admin admin] 10.222.0.59 "PUT /v2.0/routers/b58ec9d8-89ba-4ea4-9df3-441a86c90754/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5734255 Sep 16 16:41:55.902822 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45688) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:55.903366 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] Sync routers for ids ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:41:55.912354 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] Routers {'b58ec9d8-89ba-4ea4-9df3-441a86c90754'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:41:55.912954 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:56.009641 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks [] for router, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.096686 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] Set router b58ec9d8-89ba-4ea4-9df3-441a86c90754 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:41:56.110422 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.162333 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Deleting port 9c6cdacf-2d80-4f00-9380-139ce96d3989 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:56.162642 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.260657 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] For port 9c6cdacf-2d80-4f00-9380-139ce96d3989, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=9c6cdacf-2d80-4f00-9380-139ce96d3989,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:56.260657 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.267082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.277434 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222'}], 'enable_snat': True}, 'gw_port_id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:41:55Z', 'revision_number': 5, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port': {'id': '9c6cdacf-2d80-4f00-9380-139ce96d3989', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:1b:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:39:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:56.280137 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Calling delete_port for 9c6cdacf-2d80-4f00-9380-139ce96d3989 owned by network:router_gateway {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:56.303114 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] Checking router: b58ec9d8-89ba-4ea4-9df3-441a86c90754 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:41:56.311497 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] Routers {'b58ec9d8-89ba-4ea4-9df3-441a86c90754'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:41:56.312094 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:56.394331 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] Set router b58ec9d8-89ba-4ea4-9df3-441a86c90754 gateway port host: None {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:41:56.437220 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.446597 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:41:56Z', 'revision_number': 6, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:56.467639 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Pushing event deleted for resources: {'Port': ['ID=9c6cdacf-2d80-4f00-9380-139ce96d3989,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:56.473662 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22048bb9-3c19-4607-a43c-783033df4e0e None None] The sync data for ids ['b58ec9d8-89ba-4ea4-9df3-441a86c90754'] in dv-cinder-805887-15-iscsi is: [{'id': 'b58ec9d8-89ba-4ea4-9df3-441a86c90754', 'name': 'tempest-TestMinimumBasicScenario-1640464691-router', 'tenant_id': '0eb3e1ccc0654326a889abb8b6202e57', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:39:46Z', 'updated_at': '2021-09-16T16:41:56Z', 'revision_number': 6, 'project_id': '0eb3e1ccc0654326a889abb8b6202e57', 'gw_port_host': None}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:41:56.529882 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.622803 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.624923 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.666746 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.667367 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Fanout notify agent at l3_agent the message router_deleted on router b58ec9d8-89ba-4ea4-9df3-441a86c90754 {{(pid=93950) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:41:56.671697 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.672858 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1b12fbc1-6977-4ead-8ac4-eb60e297f4ae admin admin] 10.222.0.59 "DELETE /v2.0/routers/b58ec9d8-89ba-4ea4-9df3-441a86c90754 HTTP/1.1" status: 204 len: 168 time: 0.7690210 Sep 16 16:41:56.675940 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45690) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:56.721524 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Deleting subnet 269ea7ae-12a6-4fec-a8cc-02210abc6f6d {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:41:56.724853 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.757037 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.832329 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.891853 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.916132 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=269ea7ae-12a6-4fec-a8cc-02210abc6f6d,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:56.923446 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:56.928028 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1b7d1497-7d5f-48fe-b769-0ce3e6cbf4c3 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/269ea7ae-12a6-4fec-a8cc-02210abc6f6d HTTP/1.1" status: 204 len: 168 time: 0.2490866 Sep 16 16:41:56.929065 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45692) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:56.930761 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37ec34f5-6d1e-4116-bcd4-e2519f81bfd9 None None] Network fed07361-ae74-4116-ade3-e34c97349938 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:41:56.994935 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.045729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Deleting port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:41:57.046099 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.111572 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] For port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,segment=NetworkSegment(c61b3e3c-5a37-485c-a517-77e7bc7bf973),segment_id=c61b3e3c-5a37-485c-a517-77e7bc7bf973)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:41:57.111962 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.123714 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Calling delete_port for cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 owned by network:dhcp {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:41:57.208879 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.232272 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53124fd5-bdd3-45f6-888d-814190f63c19 None None] DHCP port deletion for fed07361-ae74-4116-ade3-e34c97349938 request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:41:57.236625 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=cafa3ea1-78ef-47ef-8e62-975bb2b95fb8,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:57.246151 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] No DVR routers for this DVR port cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 on host dv-cinder-805887-15-iscsi {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:41:57.316267 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.337373 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fed07361-ae74-4116-ade3-e34c97349938']}} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:57.353158 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c61b3e3c-5a37-485c-a517-77e7bc7bf973') {'for_net_delete': True} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:57.353158 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c61b3e3c-5a37-485c-a517-77e7bc7bf973') {} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:41:57.356822 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64152858'] for segment, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.369911 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.377094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Releasing vlan 716 on physical network physnet1 to pool {{(pid=93950) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:41:57.377713 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-65204239'] for segment, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: Traceback (most recent call last): Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: timer() Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: cb(*args, **kw) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: return func(*args, **kwargs) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: self._notify() Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: self.callback(batched_events) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: event.method(event) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: return f(self, *a, **k) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._get(url).json() Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: return self.request(url, 'GET', **kwargs) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:41:57.380303 dv-cinder-805887-15-iscsi neutron-server[93950]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:41:57.441171 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.455969 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.460722 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] 10.222.0.59 "DELETE /v2.0/networks/fed07361-ae74-4116-ade3-e34c97349938 HTTP/1.1" status: 204 len: 168 time: 0.5281825 Sep 16 16:41:57.460722 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50037348-d110-4eb6-8921-b4a67ac676c5 admin admin] Pushing event deleted for resources: {'Network': ['ID=fed07361-ae74-4116-ade3-e34c97349938,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:57.612385 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45696) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:57.650311 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-839343cd-38e7-4330-88e5-b15dcb5c47a3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=8b9df3c8324941d482822ccfbb50493d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0368304 Sep 16 16:41:57.652699 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45698) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:57.697485 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-272347e9-e889-45a4-81b3-4520affb767e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.717589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-272347e9-e889-45a4-81b3-4520affb767e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.761084 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-272347e9-e889-45a4-81b3-4520affb767e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.763503 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-272347e9-e889-45a4-81b3-4520affb767e admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:57.764610 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-272347e9-e889-45a4-81b3-4520affb767e admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/3b3f204f-d99f-476e-bd67-e9cfd4c76856 HTTP/1.1" status: 204 len: 168 time: 0.1110444 Sep 16 16:41:57.772001 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272347e9-e889-45a4-81b3-4520affb767e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b3f204f-d99f-476e-bd67-e9cfd4c76856,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:58.064816 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45704) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:58.102974 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-50a4e426-a6ea-4db6-91fb-821954d58805 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0eb3e1ccc0654326a889abb8b6202e57&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0364311 Sep 16 16:41:58.105200 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45706) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:58.151914 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1efd7e53-4752-4326-9445-ed2ac09ee711 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:58.171919 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1efd7e53-4752-4326-9445-ed2ac09ee711 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:58.215693 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1efd7e53-4752-4326-9445-ed2ac09ee711 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:58.218272 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-1efd7e53-4752-4326-9445-ed2ac09ee711 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:58.219456 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-1efd7e53-4752-4326-9445-ed2ac09ee711 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/cc1e9728-dade-4366-8879-547a5c62c9ea HTTP/1.1" status: 204 len: 168 time: 0.1133749 Sep 16 16:41:58.227532 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1efd7e53-4752-4326-9445-ed2ac09ee711 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc1e9728-dade-4366-8879-547a5c62c9ea,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:58.289823 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9c6cdacf-2d80-4f00-9380-139ce96d3989 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:58.309625 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 9c6cdacf-2d80-4f00-9380-139ce96d3989 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:58.309958 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9c6cdacf-2d80-4f00-9380-139ce96d3989 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:58.310360 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:58.327747 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:58.328085 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device cafa3ea1-78ef-47ef-8e62-975bb2b95fb8 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:58.328478 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9ed0a2bb-0c19-4de4-b539-4815562e72f4 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:41:58.347806 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 9ed0a2bb-0c19-4de4-b539-4815562e72f4 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:41:58.348234 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 9ed0a2bb-0c19-4de4-b539-4815562e72f4 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:41:58.881070 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45728) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:58.973815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1411048628-network', 'tenant_id': '93486203e24d4fdaae53fffa4107c694'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:41:58.993910 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Made reservation on behalf of 93486203e24d4fdaae53fffa4107c694 for: {'network': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:41:58.996551 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.004867 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.091757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.095351 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.118235 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 717} {{(pid=93951) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:41:59.127637 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ad38843-53c7-4642-bcef-3480047e82f3,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:59.135584 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.135936 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.segments_db [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Added segment ea32a20c-5996-410f-ac30-8aba1f616b9b of type vlan for network e57ebcf9-77c9-428f-8912-3e6a36b98915 Sep 16 16:41:59.177239 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.200929 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.202024 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:59.202611 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.230260 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3481033 Sep 16 16:41:59.233212 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45732) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:59.238760 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Request body: {'subnet': {'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1411048628-subnet', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'ip_version': 4}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:41:59.259324 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Made reservation on behalf of 93486203e24d4fdaae53fffa4107c694 for: {'subnet': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:41:59.261575 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64151728'] for subnet, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.263163 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59cece0d-977d-4911-b799-d199d49316a7 admin admin] Pushing event updated for resources: {'Network': ['ID=e57ebcf9-77c9-428f-8912-3e6a36b98915,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:59.272594 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:41:59.419510 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-65205906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64151710'] for subnet, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.471910 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5b036f91-e26c-4294-9679-50b6b19a5acb,revision_number=0']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:41:59.480131 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Checking segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93950) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:41:59.480484 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Network hostable DHCP agents. Network: e57ebcf9-77c9-428f-8912-3e6a36b98915, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93950) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:41:59.496844 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93950) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:41:59.506004 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, e57ebcf9-77c9-428f-8912-3e6a36b98915) {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:41:59.510178 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:41:59.510765 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.516745 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5332ddc-be72-44e6-8894-43efa1f1c1ba None None] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:41:59.523948 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-2b6a813b-1585-47e5-976c-53a12a59e111 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.2896287 Sep 16 16:41:59.526482 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45734) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:41:59.530683 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:41:59.550602 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.551638 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.605601 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.657429 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-e57ebcf9-77c9-428f-8912-3e6a36b98915', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:41:59.658289 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.735019 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.789556 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Allocated IP 172.20.0.2 (e57ebcf9-77c9-428f-8912-3e6a36b98915/5b036f91-e26c-4294-9679-50b6b19a5acb/6671198d-4d7f-4fcc-89f4-8bccfc90b94e) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:41:59.927511 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.929926 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.936266 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.946911 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:41:59.970813 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:41:59.974207 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:41:59.977659 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:00.008293 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Pushing event updated for resources: {'Port': ['ID=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:00.032916 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.033265 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.033610 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.033943 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.034840 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.035154 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.035504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.035830 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.036177 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.036505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.036826 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.037146 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:00.049789 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Attempting to bind port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:00.050156 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Attempting to bind port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:00.050517 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Attempting to bind port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:00.052571 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Allocated IP 172.27.3.129 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/18d653ce-8e71-47e1-8037-64ea3d0bea94) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:00.055837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 41, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:00.056518 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Checking segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:00.056975 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:00.057454 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Bound using segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:00.057866 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Bound port: 6671198d-4d7f-4fcc-89f4-8bccfc90b94e, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:00.058283 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:00.120385 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] For port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:00.123510 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] For port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:00.128623 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:00.156911 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:00.190466 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f62c343-df5c-40cd-832d-2a3ba06c957b None None] Pushing event updated for resources: {'Port': ['ID=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:00.195302 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:00.236272 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:00.239829 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:00.246364 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:00.249420 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Pushing event updated for resources: {'Port': ['ID=18d653ce-8e71-47e1-8037-64ea3d0bea94,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:00.750532 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:00.942381 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.021913 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d416542-19f6-42c8-81b4-8c485d973571 None None] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:42:01.069662 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Router 5db610f9-152a-4792-8370-68b1a1796620 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93950) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:42:01.086916 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-46f54e31-017a-4ac6-80fe-a77bec5949bc None None] Provisioning complete for port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:01.087316 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-46f54e31-017a-4ac6-80fe-a77bec5949bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.176518 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:42:01.192639 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.193888 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-e2584077-4d64-4e1b-ba80-263cfea37bb7 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.6664932 Sep 16 16:42:01.196512 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45736) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:01.208685 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:42:01.245772 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:01.246390 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:01.249590 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-46f54e31-017a-4ac6-80fe-a77bec5949bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.332854 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-46f54e31-017a-4ac6-80fe-a77bec5949bc None None] For port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:01.364311 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-46f54e31-017a-4ac6-80fe-a77bec5949bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.412620 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:01.488883 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f54e31-017a-4ac6-80fe-a77bec5949bc None None] Pushing event updated for resources: {'Port': ['ID=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:01.596230 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-8ce859a5-0626-4e25-a15b-cdad4ab76937 None None] Provisioning complete for port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:01.596571 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8ce859a5-0626-4e25-a15b-cdad4ab76937 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.632727 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.644587 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:00Z', 'revision_number': 3, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:01.671914 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:42:01.672261 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Updating router 5db610f9-152a-4792-8370-68b1a1796620 port 18d653ce-8e71-47e1-8037-64ea3d0bea94 binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:42:01.787675 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Allocated IP 172.20.0.1 (e57ebcf9-77c9-428f-8912-3e6a36b98915/5b036f91-e26c-4294-9679-50b6b19a5acb/33b824fd-e154-48b4-8880-28c47f312fa9) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:01.841181 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.904034 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.936396 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:01.973742 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:01.976523 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:01.979868 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:01.987320 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Pushing event updated for resources: {'Port': ['ID=33b824fd-e154-48b4-8880-28c47f312fa9,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:02.028404 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.102706 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.108875 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.156589 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.160275 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Attempting to bind port 18d653ce-8e71-47e1-8037-64ea3d0bea94 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:02.160644 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Attempting to bind port 18d653ce-8e71-47e1-8037-64ea3d0bea94 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:02.161004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Attempting to bind port 18d653ce-8e71-47e1-8037-64ea3d0bea94 on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:02.168677 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 41, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:02.169048 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:02.169397 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.169789 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:02.170258 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Bound port: 18d653ce-8e71-47e1-8037-64ea3d0bea94, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:02.170675 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.202291 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87f8678-4cf8-4dd6-be00-6a7c9e819d38 None None] Pushing event updated for resources: {'Port': ['ID=18d653ce-8e71-47e1-8037-64ea3d0bea94,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:02.235036 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-73735c16-4d6e-4083-9ce2-79697e26a1c8 None None] Provisioning complete for port 33b824fd-e154-48b4-8880-28c47f312fa9 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:02.235490 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-73735c16-4d6e-4083-9ce2-79697e26a1c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.269007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] For port 18d653ce-8e71-47e1-8037-64ea3d0bea94, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:02.273423 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] For port 18d653ce-8e71-47e1-8037-64ea3d0bea94, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=18d653ce-8e71-47e1-8037-64ea3d0bea94,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:02.280043 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-73735c16-4d6e-4083-9ce2-79697e26a1c8 None None] Port 33b824fd-e154-48b4-8880-28c47f312fa9 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:42:02.281929 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.332214 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.339300 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:02.339900 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:02.340197 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.344064 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87f8678-4cf8-4dd6-be00-6a7c9e819d38 None None] Pushing event updated for resources: {'Port': ['ID=18d653ce-8e71-47e1-8037-64ea3d0bea94,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:02.378735 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 6671198d-4d7f-4fcc-89f4-8bccfc90b94e up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:02.410677 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.413296 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Pushing event updated for resources: {'Port': ['ID=33b824fd-e154-48b4-8880-28c47f312fa9,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:02.481309 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:02.483624 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:02.483985 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.502754 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:02.504148 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:02.619144 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:42:02.735806 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-05937162-1f63-4027-8698-10461820b364 None None] Provisioning complete for port 33b824fd-e154-48b4-8880-28c47f312fa9 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:02.736177 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-05937162-1f63-4027-8698-10461820b364 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:02.736519 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:42:02.741769 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-432974b3-2438-4472-9a82-0e7539e72a7a admin admin] 10.222.0.59 "PUT /v2.0/routers/5db610f9-152a-4792-8370-68b1a1796620/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5440743 Sep 16 16:42:02.782474 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-05937162-1f63-4027-8698-10461820b364 None None] Port 33b824fd-e154-48b4-8880-28c47f312fa9 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:42:02.794695 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 2, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:02.820837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-581d2a0d-9f47-47d3-8836-dcf718be8baa None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 2, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:42:03.277153 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45752) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:03.282141 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1306288140-network', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:03.304167 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Made reservation on behalf of ef0c7fd8a0c94b85aa7943fb6a4897bf for: {'network': 1} {{(pid=93950) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:42:03.306884 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for network, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.316286 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.418019 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.434825 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.455460 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 720} {{(pid=93950) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 16 16:42:03.475953 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.476304 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.segments_db [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Added segment 07223bae-0998-49fc-b357-0fbbf1d30e53 of type vlan for network a5f6af0e-b483-43d5-abe1-1da0708c4562 Sep 16 16:42:03.477955 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8405bb84-d32e-4a24-87d1-9e327dbc7236,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:03.525770 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8727675132959'] for network, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.554265 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727'] for network, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.556019 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:03.557237 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.593617 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3153570 Sep 16 16:42:03.597275 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45754) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:03.603370 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Request body: {'subnet': {'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1306288140-subnet', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'ip_version': 4}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:03.622069 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5987c366-00c7-4a34-8eee-6a1dcb15a024 admin admin] Pushing event updated for resources: {'Network': ['ID=a5f6af0e-b483-43d5-abe1-1da0708c4562,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:03.625428 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Made reservation on behalf of ef0c7fd8a0c94b85aa7943fb6a4897bf for: {'subnet': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:42:03.628027 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58434343'] for subnet, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.632836 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 details requested by agent ovs-agent-dv-cinder-805887-15-iscsi with host dv-cinder-805887-15-iscsi {{(pid=93952) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 16 16:42:03.801648 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-58361794', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58434313'] for subnet, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.862604 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ad0caa3f-075e-4c66-b69f-f505db8ced7b,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:03.871652 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Checking segment: {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:03.872000 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Network hostable DHCP agents. Network: a5f6af0e-b483-43d5-abe1-1da0708c4562, hostable agents: ['b7246184-58be-456b-a028-aca809d519b2'], hosted agents: [] {{(pid=93951) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 16 16:42:03.888172 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 is scheduled to be hosted by DHCP agent b7246184-58be-456b-a028-aca809d519b2 with binding_index 1 {{(pid=93951) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 16 16:42:03.898444 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-805887-15-iscsi, a5f6af0e-b483-43d5-abe1-1da0708c4562) {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:03.903529 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:03.904585 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.908859 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fb6bc83-8e3a-4b77-a0a6-7abc44f069eb None None] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:42:03.920524 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-4c1c65eb-ddc0-462b-ad0e-bba805c0c784 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3213565 Sep 16 16:42:03.923087 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45756) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:03.927734 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:03.949312 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-66592395', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6622'] for router, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:03.950547 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-66589211', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-66710411', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-66816774', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6633'] for router, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.010487 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.057152 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe23ae747-0d6f-58bc-88b8-c73167b645a8-a5f6af0e-b483-43d5-abe1-1da0708c4562', 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'fixed_ips': [{'subnet_id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b'}]}} from dv-cinder-805887-15-iscsi. {{(pid=93952) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 16 16:42:04.058004 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.144531 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.192162 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.db_base_plugin_common [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Allocated IP 172.20.0.2 (a5f6af0e-b483-43d5-abe1-1da0708c4562/ad0caa3f-075e-4c66-b69f-f505db8ced7b/265aca19-5d32-4586-afe0-25976e844af6) {{(pid=93952) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:04.341176 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 18d653ce-8e71-47e1-8037-64ea3d0bea94 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:04.355130 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.373540 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.390765 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Notify callbacks [] for port, precommit_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.400347 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138'] for port, after_create {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.447920 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 is already hosted by enough agents. {{(pid=93952) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:04.448687 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 18d653ce-8e71-47e1-8037-64ea3d0bea94 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:04.449059 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.453450 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.scheduler.base_scheduler [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Resources bound (agent type, host, resource id): {{(pid=93952) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:04.456541 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Received port after_create {{(pid=93952) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:04.486323 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Allocated IP 172.27.3.115 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/d8b8287c-d4c4-4fd2-b75b-10350976edec) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:04.486800 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Pushing event updated for resources: {'Port': ['ID=265aca19-5d32-4586-afe0-25976e844af6,revision_number=1']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:04.550666 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Attempting to bind port 265aca19-5d32-4586-afe0-25976e844af6 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:04.551027 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Attempting to bind port 265aca19-5d32-4586-afe0-25976e844af6 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:04.551403 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Attempting to bind port 265aca19-5d32-4586-afe0-25976e844af6 on network a5f6af0e-b483-43d5-abe1-1da0708c4562 {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:04.558542 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 41, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:04.559073 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Checking segment: {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:04.559397 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.559696 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Bound using segment: {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:04.560120 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Bound port: 265aca19-5d32-4586-afe0-25976e844af6, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:04.560940 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.592221 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.625729 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.638679 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.666106 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:04.670413 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:04.672805 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] For port 265aca19-5d32-4586-afe0-25976e844af6, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:04.672997 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:04.678505 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 18d653ce-8e71-47e1-8037-64ea3d0bea94, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=18d653ce-8e71-47e1-8037-64ea3d0bea94,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:04.682427 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] For port 265aca19-5d32-4586-afe0-25976e844af6, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=265aca19-5d32-4586-afe0-25976e844af6,segment=NetworkSegment(07223bae-0998-49fc-b357-0fbbf1d30e53),segment_id=07223bae-0998-49fc-b357-0fbbf1d30e53)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:04.683899 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.689300 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:04.705986 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Pushing event updated for resources: {'Port': ['ID=d8b8287c-d4c4-4fd2-b75b-10350976edec,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:04.724205 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:42:04.734617 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:04.735262 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:04.746222 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=18d653ce-8e71-47e1-8037-64ea3d0bea94,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:04.803952 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a4f6d5-b41d-4079-9611-f8d120b7a9c5 None None] Pushing event updated for resources: {'Port': ['ID=265aca19-5d32-4586-afe0-25976e844af6,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:04.866966 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:04.956258 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.096042 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 2, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:05.122893 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:42:05.123269 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Updating router 5db610f9-152a-4792-8370-68b1a1796620 port 33b824fd-e154-48b4-8880-28c47f312fa9 binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:42:05.147138 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.155398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-66589204', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-66590556'] for router, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.282128 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Router 7b2e2b0d-3e39-4664-997b-e172450a98b1 is scheduled to L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 with binding_index 1 {{(pid=93950) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 16 16:42:05.421491 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.428282 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.477557 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Pushing event updated for resources: {'Port': ['ID=33b824fd-e154-48b4-8880-28c47f312fa9,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:05.486863 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.487401 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.487844 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.488267 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.488693 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.489135 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.489552 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.489967 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.490405 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.490821 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.491245 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.491675 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93953) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:42:05.553960 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Attempting to bind port 33b824fd-e154-48b4-8880-28c47f312fa9 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:05.554745 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Attempting to bind port 33b824fd-e154-48b4-8880-28c47f312fa9 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:05.555243 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Attempting to bind port 33b824fd-e154-48b4-8880-28c47f312fa9 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:05.564927 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 41, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:05.565502 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Checking segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:05.566007 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.566727 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Bound using segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:05.567235 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Bound port: 33b824fd-e154-48b4-8880-28c47f312fa9, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:05.567796 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.637514 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] For port 33b824fd-e154-48b4-8880-28c47f312fa9, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:05.640837 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] For port 33b824fd-e154-48b4-8880-28c47f312fa9, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=33b824fd-e154-48b4-8880-28c47f312fa9,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:05.647523 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.648667 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:42:05.659567 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Sync routers for ids ['7b2e2b0d-3e39-4664-997b-e172450a98b1'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:42:05.668899 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.670192 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-854ef219-5b83-40a6-bb47-4be2553bbb43 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.7460368 Sep 16 16:42:05.672628 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Routers {'7b2e2b0d-3e39-4664-997b-e172450a98b1'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:05.672776 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45762) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:05.673327 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['7b2e2b0d-3e39-4664-997b-e172450a98b1'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:05.735274 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c472a0-8816-4bd9-aec3-cd6a8968ffe8 None None] Pushing event updated for resources: {'Port': ['ID=33b824fd-e154-48b4-8880-28c47f312fa9,revision_number=4']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:05.773734 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:05.774352 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:05.829178 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Set router 7b2e2b0d-3e39-4664-997b-e172450a98b1 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:05.862126 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdad3e4e-b5d1-4c02-8157-459b72da98cb None None] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:42:05.956629 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-552483eb-f23d-4036-b7fb-bd0e92dfdf54 None None] Provisioning complete for port 33b824fd-e154-48b4-8880-28c47f312fa9 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:05.957413 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-552483eb-f23d-4036-b7fb-bd0e92dfdf54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:05.998727 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:06.042685 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:42:06.162744 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.230530 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:05Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:06.272596 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df3a6eea-4af1-4415-8cfe-1a58eb65bbed None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:05Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:42:06.377757 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-552483eb-f23d-4036-b7fb-bd0e92dfdf54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.383343 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Allocated IP 172.20.0.1 (a5f6af0e-b483-43d5-abe1-1da0708c4562/ad0caa3f-075e-4c66-b69f-f505db8ced7b/24b4a270-d20d-46a0-b8c2-12459c796e77) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:06.430322 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-552483eb-f23d-4036-b7fb-bd0e92dfdf54 None None] For port 33b824fd-e154-48b4-8880-28c47f312fa9, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=33b824fd-e154-48b4-8880-28c47f312fa9,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:06.433315 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 3, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:06.479692 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-552483eb-f23d-4036-b7fb-bd0e92dfdf54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.482639 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 265aca19-5d32-4586-afe0-25976e844af6 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:06.488388 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Checking router: 7b2e2b0d-3e39-4664-997b-e172450a98b1 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:42:06.489038 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Updating router 7b2e2b0d-3e39-4664-997b-e172450a98b1 port d8b8287c-d4c4-4fd2-b75b-10350976edec binding host dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:42:06.564985 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.590928 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.604376 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.642485 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:06.646212 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:06.648829 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:06.706313 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Pushing event updated for resources: {'Port': ['ID=24b4a270-d20d-46a0-b8c2-12459c796e77,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:06.712209 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-66590603'] for router_interface, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.826032 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-54c92e0b-3390-488f-b1b0-b30722e004c1 None None] Provisioning complete for port 33b824fd-e154-48b4-8880-28c47f312fa9 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:06.826606 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-54c92e0b-3390-488f-b1b0-b30722e004c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.867114 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-552483eb-f23d-4036-b7fb-bd0e92dfdf54 None None] Pushing event updated for resources: {'Port': ['ID=33b824fd-e154-48b4-8880-28c47f312fa9,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:06.870249 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:06.887744 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 265aca19-5d32-4586-afe0-25976e844af6 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:06.888117 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.051996 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.057363 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.082174 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Notify callbacks [] for port, precommit_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.090657 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.094431 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.109691 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-54c92e0b-3390-488f-b1b0-b30722e004c1 None None] Provisioning complete for port 265aca19-5d32-4586-afe0-25976e844af6 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:07.110059 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-54c92e0b-3390-488f-b1b0-b30722e004c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.129322 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Pushing event updated for resources: {'Port': ['ID=24b4a270-d20d-46a0-b8c2-12459c796e77,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:07.134987 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-66587565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-66588955'] for router_interface, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.202310 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port 265aca19-5d32-4586-afe0-25976e844af6, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=265aca19-5d32-4586-afe0-25976e844af6,segment=NetworkSegment(07223bae-0998-49fc-b357-0fbbf1d30e53),segment_id=07223bae-0998-49fc-b357-0fbbf1d30e53)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:07.207788 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Attempting to bind port d8b8287c-d4c4-4fd2-b75b-10350976edec on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:07.208066 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Attempting to bind port d8b8287c-d4c4-4fd2-b75b-10350976edec by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:07.208492 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Attempting to bind port d8b8287c-d4c4-4fd2-b75b-10350976edec on network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:07.211663 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67df3ce-813a-479a-9282-2c95ae4d2055 None None] Pushing event updated for resources: {'Port': ['ID=d8b8287c-d4c4-4fd2-b75b-10350976edec,revision_number=2']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:07.216314 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.217095 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 33b824fd-e154-48b4-8880-28c47f312fa9 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:07.224300 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 41, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:07.224674 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Checking segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93952) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:07.225075 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.225465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Bound using segment: {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'} {{(pid=93952) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:07.225936 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.managers [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Bound port: d8b8287c-d4c4-4fd2-b75b-10350976edec, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68cf5864-2803-4fc0-948e-ca8c09944282', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea'}}] {{(pid=93952) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:07.226310 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.235366 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:07.237086 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:07.357912 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Router 7b2e2b0d-3e39-4664-997b-e172450a98b1 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:42:07.374521 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=265aca19-5d32-4586-afe0-25976e844af6,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:07.391865 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] For port d8b8287c-d4c4-4fd2-b75b-10350976edec, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93952) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:07.399010 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] For port d8b8287c-d4c4-4fd2-b75b-10350976edec, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d8b8287c-d4c4-4fd2-b75b-10350976edec,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:07.404923 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.406667 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 33b824fd-e154-48b4-8880-28c47f312fa9 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:07.407027 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.478629 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:42:07.483538 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-1222d32d-058c-49e9-9260-b80b3ef5e67a admin admin] 10.222.0.59 "PUT /v2.0/routers/7b2e2b0d-3e39-4664-997b-e172450a98b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8098114 Sep 16 16:42:07.496867 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Routers {'7b2e2b0d-3e39-4664-997b-e172450a98b1'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:07.497493 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['7b2e2b0d-3e39-4664-997b-e172450a98b1'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:07.544359 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67df3ce-813a-479a-9282-2c95ae4d2055 None None] Pushing event updated for resources: {'Port': ['ID=d8b8287c-d4c4-4fd2-b75b-10350976edec,revision_number=3']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:07.587028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-88c4b2ea-d17c-46d7-94d5-80a0aefb3702 None None] Provisioning complete for port 24b4a270-d20d-46a0-b8c2-12459c796e77 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:07.587422 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-88c4b2ea-d17c-46d7-94d5-80a0aefb3702 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.662741 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 18d653ce-8e71-47e1-8037-64ea3d0bea94 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:07.689456 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-88c4b2ea-d17c-46d7-94d5-80a0aefb3702 None None] Port 24b4a270-d20d-46a0-b8c2-12459c796e77 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:42:07.703585 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] Set router 7b2e2b0d-3e39-4664-997b-e172450a98b1 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:07.746751 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-88c4b2ea-d17c-46d7-94d5-80a0aefb3702 None None] Provisioning complete for port 265aca19-5d32-4586-afe0-25976e844af6 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:07.747129 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-88c4b2ea-d17c-46d7-94d5-80a0aefb3702 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.843931 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 18d653ce-8e71-47e1-8037-64ea3d0bea94 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:07.844587 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:07.951508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45784) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:07.956885 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1048822809', 'description': 'tempest-secgroup-smoke-1048822809 description', 'project_id': '93486203e24d4fdaae53fffa4107c694'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:07.980587 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.069839 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.073527 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.102379 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c40fe4a8-7ad5-477f-a877-2cd9878b4376,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.104516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.105724 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-8297c89e-32ea-4dc0-9087-1f67ffc2eeec tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.1524818 Sep 16 16:42:08.108603 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45788) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:08.113431 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group_rule': {'security_group_id': 'c40fe4a8-7ad5-477f-a877-2cd9878b4376', 'project_id': '93486203e24d4fdaae53fffa4107c694', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:08.138087 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.184707 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '24b4a270-d20d-46a0-b8c2-12459c796e77', 'name': '', 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'mac_address': 'fa:16:3e:0a:a5:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:06Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 2, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'subnets': [{'id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:08.195529 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.199026 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.214355 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d386ad0-f212-420d-bbc5-2094c9d2bbe5 None None] The sync data for ids ['7b2e2b0d-3e39-4664-997b-e172450a98b1'] in dv-cinder-805887-15-iscsi is: [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '24b4a270-d20d-46a0-b8c2-12459c796e77', 'name': '', 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'mac_address': 'fa:16:3e:0a:a5:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:06Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 2, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'subnets': [{'id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:42:08.216091 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=83aa09da-a3c8-4329-a987-5f678f3f2565,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.224746 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.225975 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-b25ffc1e-a32a-4686-b795-b161676e4d5c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1164250 Sep 16 16:42:08.228641 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45790) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:08.233145 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group_rule': {'security_group_id': 'c40fe4a8-7ad5-477f-a877-2cd9878b4376', 'project_id': '93486203e24d4fdaae53fffa4107c694', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:08.260356 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.313514 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 265aca19-5d32-4586-afe0-25976e844af6 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:08.322807 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.327178 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.347672 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bbe20e8b-946a-4eb9-9022-c82a6c45beb3,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.356366 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.357645 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-4218ebda-7c13-40b1-b871-c956f2708471 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1280529 Sep 16 16:42:08.360491 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45792) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:08.364360 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 265aca19-5d32-4586-afe0-25976e844af6 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:08.364728 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.364948 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group_rule': {'security_group_id': 'c40fe4a8-7ad5-477f-a877-2cd9878b4376', 'project_id': '93486203e24d4fdaae53fffa4107c694', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:08.397034 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.468026 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 33b824fd-e154-48b4-8880-28c47f312fa9 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:08.485207 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.489327 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.510988 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c0f0ce3-216a-4620-ad3d-29fd4505ed54,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.520011 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.521434 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-3917bdf9-d40b-4698-a81d-db740e1a6b3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1599624 Sep 16 16:42:08.524229 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45794) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:08.529142 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 33b824fd-e154-48b4-8880-28c47f312fa9 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:08.529482 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group_rule': {'security_group_id': 'c40fe4a8-7ad5-477f-a877-2cd9878b4376', 'project_id': '93486203e24d4fdaae53fffa4107c694', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:08.529646 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.561800 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.628595 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.633757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.653570 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=737a24c5-223f-45de-b777-f3e86fd767c6,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.656855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.658132 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-149038ba-262a-4f78-9217-3c18ece084e9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1323934 Sep 16 16:42:08.661462 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45796) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:08.665838 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group_rule': {'security_group_id': 'c40fe4a8-7ad5-477f-a877-2cd9878b4376', 'project_id': '93486203e24d4fdaae53fffa4107c694', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:08.693267 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.securitygroups_db [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Project 93486203e24d4fdaae53fffa4107c694 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 16 16:42:08.698659 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.761098 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.764767 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.784274 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aaa23ca8-a53a-401a-967a-195b3710664b,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.790052 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.791413 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0009ed0e-840e-4540-87ef-116f2c7132bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1290162 Sep 16 16:42:08.794820 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 45798) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:08.805104 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'security_group_rule': {'security_group_id': 'c40fe4a8-7ad5-477f-a877-2cd9878b4376', 'project_id': '93486203e24d4fdaae53fffa4107c694', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:08.833090 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.securitygroups_db [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Project 93486203e24d4fdaae53fffa4107c694 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 16 16:42:08.838355 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.899389 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.902826 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66658877'] for security_group_rule, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.919552 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31f1a317-ec9f-48a8-a4b1-29bf6aed4fdf,revision_number=0']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:08.925456 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:08.926723 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-285ea7da-28f8-48dc-bed8-2833ce631e60 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1275122 Sep 16 16:42:10.305832 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Sync routers for ids ['7b2e2b0d-3e39-4664-997b-e172450a98b1'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:42:10.309941 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d8b8287c-d4c4-4fd2-b75b-10350976edec up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:10.317285 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Routers {'7b2e2b0d-3e39-4664-997b-e172450a98b1'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:10.317889 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['7b2e2b0d-3e39-4664-997b-e172450a98b1'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:10.360362 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port d8b8287c-d4c4-4fd2-b75b-10350976edec triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:10.360732 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:10.429732 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Set router 7b2e2b0d-3e39-4664-997b-e172450a98b1 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:10.444571 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:10.466313 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] For port d8b8287c-d4c4-4fd2-b75b-10350976edec, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d8b8287c-d4c4-4fd2-b75b-10350976edec,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:10.470417 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:10.519697 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Pushing event updated for resources: {'Port': ['ID=d8b8287c-d4c4-4fd2-b75b-10350976edec,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:10.631108 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '24b4a270-d20d-46a0-b8c2-12459c796e77', 'name': '', 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'mac_address': 'fa:16:3e:0a:a5:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:06Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 2, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'subnets': [{'id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:10.656458 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Checking router: 7b2e2b0d-3e39-4664-997b-e172450a98b1 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:42:10.656811 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Updating router 7b2e2b0d-3e39-4664-997b-e172450a98b1 port 24b4a270-d20d-46a0-b8c2-12459c796e77 binding host dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 16 16:42:10.684658 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:10.948053 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Notify callbacks [] for port, precommit_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:10.954218 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.002225 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc075b37-108b-428e-966b-f5d1868ffa23 None None] Pushing event updated for resources: {'Port': ['ID=24b4a270-d20d-46a0-b8c2-12459c796e77,revision_number=3']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:11.057767 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Attempting to bind port 24b4a270-d20d-46a0-b8c2-12459c796e77 on host dv-cinder-805887-15-iscsi for vnic_type normal with profile {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:11.058140 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Attempting to bind port 24b4a270-d20d-46a0-b8c2-12459c796e77 by drivers openvswitch,hyperv on host dv-cinder-805887-15-iscsi at level 0 using segments [{'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:11.058498 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Attempting to bind port 24b4a270-d20d-46a0-b8c2-12459c796e77 on network a5f6af0e-b483-43d5-abe1-1da0708c4562 {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:11.063669 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Checking agent: {'id': '0e828db6-a20d-4ce5-944c-9be82bdcb573', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-805887-15-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 14, 24), 'started_at': datetime.datetime(2021, 9, 16, 16, 14, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 41, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-805887-15-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:11.064031 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Checking segment: {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93953) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:11.064429 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.064816 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Bound using segment: {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'} {{(pid=93953) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:11.065279 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.managers [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Bound port: 24b4a270-d20d-46a0-b8c2-12459c796e77, host: dv-cinder-805887-15-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '07223bae-0998-49fc-b357-0fbbf1d30e53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 720, 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562'}}] {{(pid=93953) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:11.065671 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.130396 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] For port 24b4a270-d20d-46a0-b8c2-12459c796e77, host dv-cinder-805887-15-iscsi, cleared binding levels {{(pid=93953) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:11.133492 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.plugins.ml2.db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] For port 24b4a270-d20d-46a0-b8c2-12459c796e77, host dv-cinder-805887-15-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=24b4a270-d20d-46a0-b8c2-12459c796e77,segment=NetworkSegment(07223bae-0998-49fc-b357-0fbbf1d30e53),segment_id=07223bae-0998-49fc-b357-0fbbf1d30e53)] {{(pid=93953) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:11.138659 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron_lib.callbacks.manager [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93953) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.176796 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-f25d686d-ee26-4dd9-bef3-c21e0f66ea17 None None] Provisioning complete for port 24b4a270-d20d-46a0-b8c2-12459c796e77 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:11.177233 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f25d686d-ee26-4dd9-bef3-c21e0f66ea17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.191399 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Routers {'7b2e2b0d-3e39-4664-997b-e172450a98b1'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:11.192008 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:41:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['7b2e2b0d-3e39-4664-997b-e172450a98b1'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:11.241900 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc075b37-108b-428e-966b-f5d1868ffa23 None None] Pushing event updated for resources: {'Port': ['ID=24b4a270-d20d-46a0-b8c2-12459c796e77,revision_number=4']} {{(pid=93953) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:11.274461 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f25d686d-ee26-4dd9-bef3-c21e0f66ea17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.309680 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-f25d686d-ee26-4dd9-bef3-c21e0f66ea17 None None] For port 24b4a270-d20d-46a0-b8c2-12459c796e77, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=24b4a270-d20d-46a0-b8c2-12459c796e77,segment=NetworkSegment(07223bae-0998-49fc-b357-0fbbf1d30e53),segment_id=07223bae-0998-49fc-b357-0fbbf1d30e53)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:11.313697 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-f25d686d-ee26-4dd9-bef3-c21e0f66ea17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.315859 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] Set router 7b2e2b0d-3e39-4664-997b-e172450a98b1 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:11.364394 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25d686d-ee26-4dd9-bef3-c21e0f66ea17 None None] Pushing event updated for resources: {'Port': ['ID=24b4a270-d20d-46a0-b8c2-12459c796e77,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:11.432400 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-3f36a207-a44e-4b3f-817a-ceea218f0167 None None] Provisioning complete for port 24b4a270-d20d-46a0-b8c2-12459c796e77 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:11.432681 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3f36a207-a44e-4b3f-817a-ceea218f0167 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:11.521419 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '24b4a270-d20d-46a0-b8c2-12459c796e77', 'name': '', 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'mac_address': 'fa:16:3e:0a:a5:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:06Z', 'updated_at': '2021-09-16T16:42:11Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'subnets': [{'id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:11.546684 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eca9754-a21c-41a6-bf59-eb5cc7c07302 None None] The sync data for ids ['7b2e2b0d-3e39-4664-997b-e172450a98b1'] in dv-cinder-805887-15-iscsi is: [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '24b4a270-d20d-46a0-b8c2-12459c796e77', 'name': '', 'network_id': 'a5f6af0e-b483-43d5-abe1-1da0708c4562', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'mac_address': 'fa:16:3e:0a:a5:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 682, 'fixed_ips': [{'subnet_id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:06Z', 'updated_at': '2021-09-16T16:42:11Z', 'revision_number': 4, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'subnets': [{'id': 'ad0caa3f-075e-4c66-b69f-f505db8ced7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:42:12.312814 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24b4a270-d20d-46a0-b8c2-12459c796e77 up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:12.360139 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port 24b4a270-d20d-46a0-b8c2-12459c796e77 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:12.360859 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:12.436423 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d8b8287c-d4c4-4fd2-b75b-10350976edec up at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:12.483998 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Provisioning complete for port d8b8287c-d4c4-4fd2-b75b-10350976edec triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:12.484276 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:15.954047 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:20.744175 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c46a59b5-4a65-4c07-9cb2-7417fd2649b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:23.457013 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-bd5ee50c-4b0f-4203-ac51-d2394484e399 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:23.745165 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:24.452446 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:25.384561 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-b137f658-9f09-455e-a817-ffdd0c135b74 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1048822809&fields=id&tenant_id=93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 267 time: 0.0313199 Sep 16 16:42:25.485940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-5dc817ae-3ab9-408f-a2fa-c6925889b257 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:25.487380 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-5dc817ae-3ab9-408f-a2fa-c6925889b257 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 812 time: 0.0965326 Sep 16 16:42:25.502047 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-b16bade9-f72d-453e-82ed-17f801185948 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/quotas/93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 375 time: 0.0085211 Sep 16 16:42:25.559839 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-0c34f15e-69af-442a-86f6-12008f74beed tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0520439 Sep 16 16:42:25.650828 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-ae41bfcd-d975-417a-836e-f5ebecdcdab8 service neutron] 10.222.0.59 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792694 Sep 16 16:42:25.740050 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-39cff617-e7d1-470a-aa9c-5c45e02a56ae service neutron] 10.222.0.59 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831382 Sep 16 16:42:26.014376 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-550d1019-1c48-48f5-8aaa-0aa4bf78cc57 req-1fb71cc7-3156-40f6-9ae7-b9986b06e532 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 210 time: 0.0260978 Sep 16 16:42:26.301955 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.035516 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-b4111d07-b349-4ce1-bd9c-933342d2fbf4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:27.036971 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-b4111d07-b349-4ce1-bd9c-933342d2fbf4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 812 time: 0.0982728 Sep 16 16:42:27.087535 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-4a4f2b28-65ae-43aa-bf9f-c129fe3eefb7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 380 time: 0.0416028 Sep 16 16:42:27.100099 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'port': {'device_id': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'admin_state_up': True, 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'security_groups': ['c40fe4a8-7ad5-477f-a877-2cd9878b4376']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:27.126638 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b93fcde8-a4c1-4b4c-b920-c441764be299 req-66798696-a602-4d86-93cc-2764612b9594 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 210 time: 0.0444820 Sep 16 16:42:27.220430 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Made reservation on behalf of 93486203e24d4fdaae53fffa4107c694 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:42:27.223926 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.345432 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Allocated IP 172.20.0.7 (e57ebcf9-77c9-428f-8912-3e6a36b98915/5b036f91-e26c-4294-9679-50b6b19a5acb/1e5ea1b7-fd2c-4b3b-87f5-bb0508014238) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:27.492773 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.525431 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.565982 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:27.569093 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:27.571773 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:27.600984 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:27.628964 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:27.629727 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.644422 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-2b44a0de-cc5d-4a5f-946e-467ae36beb7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5485964 Sep 16 16:42:27.655009 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-da2cf4dc-d4ab-4e36-b6bb-793fbb65003b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93951) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:42:27.656042 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-da2cf4dc-d4ab-4e36-b6bb-793fbb65003b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0056102 Sep 16 16:42:27.668141 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Request body: {'port': {'device_id': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:27.727590 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.838241 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-3530eea6-086c-4de3-866e-a20f9ed108cc None None] Provisioning complete for port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:27.838836 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3530eea6-086c-4de3-866e-a20f9ed108cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:27.880327 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-3530eea6-086c-4de3-866e-a20f9ed108cc None None] Port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:42:27.982945 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:42:27.990424 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:28.001663 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Transition to ACTIVE for port object 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:42:28.005539 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:28.056815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Pushing event updated for resources: {'Port': ['ID=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:28.129585 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Attempting to bind port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:42:28.129918 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Attempting to bind port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:42:28.130248 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Attempting to bind port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:28.134685 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:42:28.135005 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Attempting to bind port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:42:28.139998 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 42, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:42:28.140336 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Checking segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:42:28.140719 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Bound using segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:42:28.141145 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Bound port: 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:42:28.141505 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:28.211761 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] For port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:42:28.214959 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] For port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:42:28.220879 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:28.250828 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4a1d1c-a856-4bf1-918a-22b676309151 req-17821a1b-16da-415c-b831-2d2acf4f5bd8 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.253550 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d4a1d1c-a856-4bf1-918a-22b676309151 req-17821a1b-16da-415c-b831-2d2acf4f5bd8 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0569434 Sep 16 16:42:28.257141 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.257756 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:28.259134 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] 10.222.0.66 "PUT /v2.0/ports/1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 HTTP/1.1" status: 200 len: 1093 time: 0.5952647 Sep 16 16:42:28.259605 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:42:28.261814 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1" -d '{"events": [{"name": "network-changed", "server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:42:28.284547 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8b360a-5bbc-4e30-9983-69857d7dbaaa service neutron] Pushing event updated for resources: {'Port': ['ID=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:28.300737 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-7d4a1d1c-a856-4bf1-918a-22b676309151 req-eb286eab-3c15-49cf-872d-4f6e1e3e0364 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405114 Sep 16 16:42:28.338018 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:42:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c2f4dc1-9d06-4b76-bbe6-b4f0233d0c20 x-openstack-request-id: req-0c2f4dc1-9d06-4b76-bbe6-b4f0233d0c20 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:42:28.339155 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:42:28.339510 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-0c2f4dc1-9d06-4b76-bbe6-b4f0233d0c20 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:42:28.339986 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'status': 'completed', 'code': 200} Sep 16 16:42:28.445387 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-b8a13027-28c9-4373-93d8-bf1108f7030a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.447150 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-b8a13027-28c9-4373-93d8-bf1108f7030a service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 1096 time: 0.1392438 Sep 16 16:42:28.488159 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-ba1cce20-f7c5-456c-9474-c9bf381758e9 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 HTTP/1.1" status: 200 len: 217 time: 0.0326355 Sep 16 16:42:28.534964 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-d10a7930-c1d2-4bb6-8649-4ababfec4a23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.536442 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-d10a7930-c1d2-4bb6-8649-4ababfec4a23 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0417171 Sep 16 16:42:28.584042 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-9ab97839-cb5d-48b8-a193-88777551ec51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.585462 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-9ab97839-cb5d-48b8-a193-88777551ec51 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0421622 Sep 16 16:42:28.671689 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-fa3d45b6-811e-4ae8-8a76-390cd9354438 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786510 Sep 16 16:42:28.762815 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aea6015b-4a58-4db9-9438-d957a3cb9d3c req-a384cd2d-ec24-4bc1-8bce-7beb6ecf4b91 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838578 Sep 16 16:42:28.842080 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-7f2d9755-251d-4461-9882-bb5aae77ec0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.843545 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-7f2d9755-251d-4461-9882-bb5aae77ec0c service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 1096 time: 0.0392697 Sep 16 16:42:28.934751 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-14b7b09e-37e8-47e1-8d91-eaa442c4ed74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:28.936148 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-14b7b09e-37e8-47e1-8d91-eaa442c4ed74 service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0839436 Sep 16 16:42:28.975593 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-ff7227a8-265e-43d7-8236-a759cae82834 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 HTTP/1.1" status: 200 len: 217 time: 0.0323050 Sep 16 16:42:29.022543 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-844cfd21-1036-4ead-b5b9-ff4260e7eb7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:29.023948 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-844cfd21-1036-4ead-b5b9-ff4260e7eb7e service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0413730 Sep 16 16:42:29.067776 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-e069fed9-2901-4beb-abb4-68d5f987c7de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:29.069181 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-e069fed9-2901-4beb-abb4-68d5f987c7de service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0383279 Sep 16 16:42:29.157069 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-8e616e5b-6d5a-4452-bea3-a183483e2750 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806861 Sep 16 16:42:29.253900 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d64b96dd-ab3b-4ae7-a928-f8cf7a598dc1 req-9c4e9c66-1281-43a2-aef0-fa246cee8f5d service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898402 Sep 16 16:42:29.412922 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61201d17-702c-41ad-a9e3-a4f9af17b9ad req-e6c1296b-3168-4761-9af1-320888402de4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:29.414385 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-61201d17-702c-41ad-a9e3-a4f9af17b9ad req-e6c1296b-3168-4761-9af1-320888402de4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0474832 Sep 16 16:42:29.450556 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-61201d17-702c-41ad-a9e3-a4f9af17b9ad req-cfac1ef8-fc47-4a27-84f7-03029a296312 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304227 Sep 16 16:42:30.562579 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e137229-85b2-466f-b55e-d5c2db1a3d49 req-bb033037-c522-465b-8368-0365d0876cc4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:30.564058 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7e137229-85b2-466f-b55e-d5c2db1a3d49 req-bb033037-c522-465b-8368-0365d0876cc4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0477839 Sep 16 16:42:30.600267 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-7e137229-85b2-466f-b55e-d5c2db1a3d49 req-3bd33256-48c4-48d2-8e7e-9449093ce683 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304360 Sep 16 16:42:31.711737 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c905c95c-575f-481e-9f01-d492f06835c2 req-a579ab7d-f174-45f0-bbdf-815755bfc120 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:31.713177 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c905c95c-575f-481e-9f01-d492f06835c2 req-a579ab7d-f174-45f0-bbdf-815755bfc120 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0480113 Sep 16 16:42:31.749724 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c905c95c-575f-481e-9f01-d492f06835c2 req-6d545563-f3d4-4fc3-b459-e35d0ba3341b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307665 Sep 16 16:42:32.861747 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-098a3360-c0f6-4768-a974-c7c50244253d req-0c6d934a-f89d-4b16-8b20-5b06a24a1a83 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:32.863194 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-098a3360-c0f6-4768-a974-c7c50244253d req-0c6d934a-f89d-4b16-8b20-5b06a24a1a83 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0463777 Sep 16 16:42:32.898871 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-098a3360-c0f6-4768-a974-c7c50244253d req-74bb94c4-2d86-415f-a2ba-d1e4c55db26d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0293756 Sep 16 16:42:33.023242 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00c64190-c054-4198-9d35-02d6ed34c4ee req-8591624a-0e24-44a7-ae7f-7b1d7b6c055d service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0273974 Sep 16 16:42:33.086858 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00c64190-c054-4198-9d35-02d6ed34c4ee req-748e091b-1fac-4d46-a3e9-d164e6983f08 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0235653 Sep 16 16:42:33.123368 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00c64190-c054-4198-9d35-02d6ed34c4ee req-383f13ba-2082-4a2e-945b-a3b9ffd8b9d5 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0179119 Sep 16 16:42:33.214386 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c64190-c054-4198-9d35-02d6ed34c4ee req-993d10fb-5d70-433b-82f8-86e6809a2c63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:33.215859 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-00c64190-c054-4198-9d35-02d6ed34c4ee req-993d10fb-5d70-433b-82f8-86e6809a2c63 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0856733 Sep 16 16:42:34.011362 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa7f35b-1c03-476c-b607-471bab883923 req-20732083-cc52-4400-88ec-91860aa033f1 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:34.012788 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ffa7f35b-1c03-476c-b607-471bab883923 req-20732083-cc52-4400-88ec-91860aa033f1 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0503476 Sep 16 16:42:34.047842 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-ffa7f35b-1c03-476c-b607-471bab883923 req-013cdbf7-5ef8-4030-8434-68536ce25e54 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0293345 Sep 16 16:42:35.161488 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb95cf6-0d0e-47f2-8400-b8006a8e3e12 req-60c1824b-c91e-4bfe-813c-12f29ebd09a0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:35.162913 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aeb95cf6-0d0e-47f2-8400-b8006a8e3e12 req-60c1824b-c91e-4bfe-813c-12f29ebd09a0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0505188 Sep 16 16:42:35.202968 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aeb95cf6-0d0e-47f2-8400-b8006a8e3e12 req-dc2bf423-dbe8-4dd4-93ea-3ab493239d7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314522 Sep 16 16:42:36.308936 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2bf4b0b-0356-4449-9757-9fa52f17bfea req-b3d29c2c-49d2-441c-83fd-27113b29a2af tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:36.310371 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d2bf4b0b-0356-4449-9757-9fa52f17bfea req-b3d29c2c-49d2-441c-83fd-27113b29a2af tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0471592 Sep 16 16:42:36.346642 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d2bf4b0b-0356-4449-9757-9fa52f17bfea req-cd4f969e-c213-4b5e-81aa-07496f40b3cb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303197 Sep 16 16:42:37.301453 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:42:37.391857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:37.402633 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'port_id': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'mac_address': 'fa:16:3e:00:90:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 717, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:42:37.442410 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:37.454493 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:42:37.455432 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3502420-2002-46fd-a47f-c4aaf0fe70f1 req-de116031-0480-44c0-aa15-a760560d166d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:37.457417 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a3502420-2002-46fd-a47f-c4aaf0fe70f1 req-de116031-0480-44c0-aa15-a760560d166d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 943 time: 0.0480826 Sep 16 16:42:37.474482 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:37.478511 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:37.495761 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a3502420-2002-46fd-a47f-c4aaf0fe70f1 req-3a1db5fe-b627-403f-872e-a0eb396f888d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321658 Sep 16 16:42:37.534005 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:37.722544 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['1e5ea1b7-fd2c-4b3b-87f5-bb0508014238'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:42:38.606991 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2996cfc5-6d78-43cb-9a46-3b0636f4ccf2 req-7845255e-0771-4cd8-921f-5b7a24b46d06 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:38.608483 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2996cfc5-6d78-43cb-9a46-3b0636f4ccf2 req-7845255e-0771-4cd8-921f-5b7a24b46d06 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 944 time: 0.0480955 Sep 16 16:42:38.644923 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2996cfc5-6d78-43cb-9a46-3b0636f4ccf2 req-7eba4649-2fe7-47e7-8335-ead38b5aa028 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0301366 Sep 16 16:42:39.316048 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:42:39.363766 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:42:39.367294 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:42:39.367664 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:39.443742 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:39.465219 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:42:39.467392 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d2eb1c3-c0c6-4ecb-9f9a-000b3bad9f23" -d '{"events": [{"server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "name": "network-vif-plugged", "status": "completed", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:42:39.480255 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:42:39.484336 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:39.506960 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:42:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f2e3492-9579-4e14-b835-65e35ebe8cfb x-openstack-request-id: req-7f2e3492-9579-4e14-b835-65e35ebe8cfb {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:42:39.507277 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "name": "network-vif-plugged", "status": "completed", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:42:39.507533 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-7f2e3492-9579-4e14-b835-65e35ebe8cfb {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:42:39.507919 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'code': 200} Sep 16 16:42:39.532616 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:39.706409 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5093920-e482-4019-8e2a-8c1368d44e32 req-32f3f939-c58b-404a-8d8d-b4c1adcc8c0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:39.708421 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c5093920-e482-4019-8e2a-8c1368d44e32 req-32f3f939-c58b-404a-8d8d-b4c1adcc8c0a service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 1098 time: 0.0400057 Sep 16 16:42:39.742500 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c5093920-e482-4019-8e2a-8c1368d44e32 req-8586b0a2-0081-4cec-b4d1-712af32195b8 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0270710 Sep 16 16:42:39.761353 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af2a56c-a953-4f85-a2d5-988412582fd5 req-e03528f1-ce11-4207-a7aa-92dbabd9793b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:39.762820 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1af2a56c-a953-4f85-a2d5-988412582fd5 req-e03528f1-ce11-4207-a7aa-92dbabd9793b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 945 time: 0.0515122 Sep 16 16:42:39.803735 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1af2a56c-a953-4f85-a2d5-988412582fd5 req-1b5c4ffd-741b-4986-aea1-f71f335ebffb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348747 Sep 16 16:42:40.925075 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6cd032-c40d-41ea-b33b-1aea1de05b74 req-02daef84-041c-4d66-845a-d73e46b3b1d7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:40.926500 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-de6cd032-c40d-41ea-b33b-1aea1de05b74 req-02daef84-041c-4d66-845a-d73e46b3b1d7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 945 time: 0.0507283 Sep 16 16:42:40.964477 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-de6cd032-c40d-41ea-b33b-1aea1de05b74 req-5c2d9dfb-1222-4f8b-93e4-38d2d4562f05 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311267 Sep 16 16:42:41.073464 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b83697c-f8bf-47c1-8cd7-04bb27275ffd req-6557c449-9650-4d87-9a0b-e6ee5a1e84df tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:41.074903 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8b83697c-f8bf-47c1-8cd7-04bb27275ffd req-6557c449-9650-4d87-9a0b-e6ee5a1e84df tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 945 time: 0.0467544 Sep 16 16:42:41.110452 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8b83697c-f8bf-47c1-8cd7-04bb27275ffd req-724da8dd-3892-4168-b8f1-a6fc91c3adf5 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0296917 Sep 16 16:42:41.132036 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45964) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:41.218780 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a723597f-1d3b-442f-b047-3bcdbf9158d5 tempest-TestVolumeBootPattern-96547063 tempest-TestVolumeBootPattern-96547063-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:41.220363 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-a723597f-1d3b-442f-b047-3bcdbf9158d5 tempest-TestVolumeBootPattern-96547063 tempest-TestVolumeBootPattern-96547063-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 1093 time: 0.0873816 Sep 16 16:42:41.223180 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 45968) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:42:41.227436 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'port_id': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address': '172.20.0.7'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:42:41.248636 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:41.346099 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:41.444857 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Allocated IP 172.27.3.175 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/6d348f29-7421-473f-ab7c-b295ca970ab1) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:42:41.543558 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:41.576414 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:41.611289 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:42:41.614700 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:42:41.618115 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:42:41.644868 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=6d348f29-7421-473f-ab7c-b295ca970ab1,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:41.970261 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:42.031803 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:42.174176 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:42.178315 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:42.251272 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=6d348f29-7421-473f-ab7c-b295ca970ab1,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:42:42.259295 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:42.356827 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Floating IP e72a651a-9f3b-4b76-909c-7bd9e942f382 associated. External IP: 172.27.3.175, port: 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238. Sep 16 16:42:42.550773 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:42:42.654599 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:42:42.664072 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:42:42.670606 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:42.674048 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:42.674664 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:42:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:42.700674 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-537bbe88-bfa5-40d0-a149-c785bb11108d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.4764681 Sep 16 16:42:42.701361 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:42:42.703630 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87f036a7-0ebe-4ca5-bd80-442a13591a65" -d '{"events": [{"name": "network-changed", "server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:42:42.739314 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:42:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01fcca9c-9782-4471-aa6b-a5203b582024 x-openstack-request-id: req-01fcca9c-9782-4471-aa6b-a5203b582024 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:42:42.739600 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:42:42.739854 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-01fcca9c-9782-4471-aa6b-a5203b582024 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:42:42.740251 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'status': 'completed', 'code': 200} Sep 16 16:42:42.782244 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:42.803589 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-fb0c40db-4e17-4e4f-b965-10f18aec9ce5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:42.805535 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-fb0c40db-4e17-4e4f-b965-10f18aec9ce5 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 1098 time: 0.0447633 Sep 16 16:42:42.895556 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-9ba87310-6e27-47a9-919f-c983560bce6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:42.897025 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-9ba87310-6e27-47a9-919f-c983560bce6a service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0849922 Sep 16 16:42:42.959645 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-d4fa23c7-5d5e-4833-a3fd-be53752eae75 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 HTTP/1.1" status: 200 len: 999 time: 0.0558665 Sep 16 16:42:43.002954 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': 'e72a651a-9f3b-4b76-909c-7bd9e942f382', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.175', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 694, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:00:90:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:42:41Z', 'updated_at': '2021-09-16T16:42:41Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:43.006580 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-8af7de2f-1303-4254-b301-fc815f6497ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:43.008046 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-8af7de2f-1303-4254-b301-fc815f6497ae service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0422645 Sep 16 16:42:43.029289 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:42:43.037467 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:42:43.038090 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:42:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:43.042547 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:42:43.057411 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-a966cae4-3512-48c9-84aa-e703a77f29b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:42:43.058796 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-a966cae4-3512-48c9-84aa-e703a77f29b9 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0431731 Sep 16 16:42:43.140779 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:42:43.145650 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-07bacadb-c79b-40e6-84b1-7aba8d8eaff3 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794954 Sep 16 16:42:43.238765 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-87f036a7-0ebe-4ca5-bd80-442a13591a65 req-09cc17b9-530b-4805-83d8-212e1fd78b86 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860035 Sep 16 16:42:43.371900 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': 'e72a651a-9f3b-4b76-909c-7bd9e942f382', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.175', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 694, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:00:90:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:42:41Z', 'updated_at': '2021-09-16T16:42:41Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:42:43.400300 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7af10f5f-4fed-403f-b980-49c250f67596 None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': 'e72a651a-9f3b-4b76-909c-7bd9e942f382', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.175', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 694, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:00:90:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:42:41Z', 'updated_at': '2021-09-16T16:42:41Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:42:43.576840 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4f2c854-30c9-4f1a-88a4-755567e6222b None None] New status for floating IP e72a651a-9f3b-4b76-909c-7bd9e942f382: ACTIVE {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:42:45.974074 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:50.744465 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-096f1d7a-86d8-4d19-9a05-399428255116 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:53.457821 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-68ce5774-48bf-4326-91e2-3f1fa63fad7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:53.746546 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:54.455429 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:42:56.266555 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:15.970188 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:20.040965 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:43:20.744301 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-7f543e7d-26f1-4a0a-964c-1847c394e3d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:23.456900 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-89954048-9d67-4375-8e77-9e051fbef55c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:23.748261 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:24.458355 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:26.269602 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:34.550118 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7b51557-be89-4042-982c-2402307879c0 req-3c45821e-a2f7-484f-bcbf-569f107ca2ea service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0240209 Sep 16 16:43:34.613847 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7b51557-be89-4042-982c-2402307879c0 req-01e8a2e5-c23f-41f5-aea4-79dbc51e7799 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0240204 Sep 16 16:43:34.650286 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7b51557-be89-4042-982c-2402307879c0 req-7344d734-1bfa-4c73-9e2a-664df9783d2f service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0177743 Sep 16 16:43:34.743774 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b51557-be89-4042-982c-2402307879c0 req-172304bb-5486-4091-875f-17572c99fece service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:43:34.745223 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c7b51557-be89-4042-982c-2402307879c0 req-172304bb-5486-4091-875f-17572c99fece service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0868435 Sep 16 16:43:45.986186 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:50.744484 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8a11ccd9-f29a-4e21-bc3c-5618c5e5ffb3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:53.456926 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9079a1cb-16e5-4e71-9fe5-76a111689722 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:53.750521 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:54.460825 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:56.273377 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:43:57.039623 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:44:15.986199 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:20.744591 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-aaaca513-8c9b-4a78-9d13-17652bf091d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:23.458545 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-9e710569-5fef-4ea2-b175-b433ddf6b6ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:23.753028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:24.464536 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:26.278279 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:34.037931 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:44:35.012185 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-5c649d91-cc0b-4ef9-b9ef-ddf4cffa5721 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390871 Sep 16 16:44:35.071011 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-e24f6ad4-9497-4f52-8cd9-5e39e2017229 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:35.072451 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-e24f6ad4-9497-4f52-8cd9-5e39e2017229 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 1098 time: 0.0382171 Sep 16 16:44:35.179703 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-efff5f9d-a195-4011-9da6-cc4d52509144 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:35.181448 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-efff5f9d-a195-4011-9da6-cc4d52509144 service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0907843 Sep 16 16:44:35.245744 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-64d1139f-010a-4202-8eda-af08d3325d23 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 HTTP/1.1" status: 200 len: 1001 time: 0.0551574 Sep 16 16:44:35.296401 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-25753484-ab0e-4f42-84b0-9e88f6cc5122 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:35.297685 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-25753484-ab0e-4f42-84b0-9e88f6cc5122 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0445209 Sep 16 16:44:35.340705 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-3f84a5c7-47d8-41e9-9bb0-7efff2232500 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:35.342115 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-3f84a5c7-47d8-41e9-9bb0-7efff2232500 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0380657 Sep 16 16:44:35.426045 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-cd2f4ff5-265a-4632-89ac-e86f4f5d51ef service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0766444 Sep 16 16:44:35.513255 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-dbe0119f-d25a-4eab-a493-bc58ace5ef16 req-2bc49665-60a6-473a-aced-9e86ab711467 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806303 Sep 16 16:44:38.199525 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c64aa-f27f-46e5-a907-2eb1bc3dab5f req-edb1df10-66a2-4e35-abb5-8d0191e96ce0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:38.200892 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f19c64aa-f27f-46e5-a907-2eb1bc3dab5f req-edb1df10-66a2-4e35-abb5-8d0191e96ce0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 945 time: 0.0952876 Sep 16 16:44:38.237341 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-f19c64aa-f27f-46e5-a907-2eb1bc3dab5f req-2f703dfd-e72c-4b6d-a08c-043e3cad2c61 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306838 Sep 16 16:44:39.415810 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6dc080-b8e8-47a3-bea8-3ddbdffeecc7 req-17f1498a-d553-495e-9b6d-3f9fd8d83372 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:39.417301 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2f6dc080-b8e8-47a3-bea8-3ddbdffeecc7 req-17f1498a-d553-495e-9b6d-3f9fd8d83372 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 945 time: 0.0956786 Sep 16 16:44:39.454496 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2f6dc080-b8e8-47a3-bea8-3ddbdffeecc7 req-85c742fc-9a54-451a-9b56-078b8b5bdc69 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313783 Sep 16 16:44:39.634465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-24f174be-dc81-45c8-8c77-eac5df0178c0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:39.635899 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-24f174be-dc81-45c8-8c77-eac5df0178c0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 945 time: 0.0469797 Sep 16 16:44:39.726148 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Deleting port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:44:39.726426 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:39.816192 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] For port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:44:39.816546 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:39.973443 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:39.973811 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:39.974162 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.l3_db [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Floating IP e72a651a-9f3b-4b76-909c-7bd9e942f382 disassociated. External IP: 172.27.3.175, port: 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238. Sep 16 16:44:39.974540 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Calling delete_port for 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:44:40.101072 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:40.376461 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'Port': ['ID=1e5ea1b7-fd2c-4b3b-87f5-bb0508014238,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:40.387792 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.388142 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.388481 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.388816 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.389148 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.389477 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.389813 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.390142 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.390469 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.390792 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.391109 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.391448 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:40.501796 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:44:40.574197 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-cc42d402-2852-4199-aa8e-5e3a05f7e480 req-9f99f40d-c544-4400-ab85-aad823aa08a4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=df4b5ce6-c780-44a2-accc-3fa812e9f4ee HTTP/1.1" status: 200 len: 210 time: 0.0306616 Sep 16 16:44:40.631454 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:44:40.642230 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:44:40.651767 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:44:40.652310 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:44:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:40.668590 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] No DVR routers for this DVR port 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:44:40.671072 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:40.673042 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-fe2568ee-2f08-406f-b31d-378bc33553ec req-9e3da5d2-06d9-4082-bc79-237bfd20dc40 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "DELETE /v2.0/ports/1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 HTTP/1.1" status: 204 len: 173 time: 1.0302014 Sep 16 16:44:40.673482 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'name': 'network-vif-deleted', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:44:40.675717 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed6ffc57-f947-43cd-b450-9a45d7fff85c" -d '{"events": [{"server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "name": "network-vif-deleted", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:44:40.761972 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:44:40.786992 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:44:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ae4b311-375f-4e19-92fb-450afbbc8801 x-openstack-request-id: req-8ae4b311-375f-4e19-92fb-450afbbc8801 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:44:40.787384 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "df4b5ce6-c780-44a2-accc-3fa812e9f4ee", "name": "network-vif-deleted", "tag": "1e5ea1b7-fd2c-4b3b-87f5-bb0508014238", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:44:40.787702 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-8ae4b311-375f-4e19-92fb-450afbbc8801 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:44:40.788167 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df4b5ce6-c780-44a2-accc-3fa812e9f4ee', 'name': 'network-vif-deleted', 'tag': '1e5ea1b7-fd2c-4b3b-87f5-bb0508014238', 'status': 'completed', 'code': 200} Sep 16 16:44:40.958713 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:40.984382 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:44:40.992923 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:44:40.993529 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:44:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:41.098813 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:44:41.303370 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:41.330240 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e26eb740-0db4-4c9e-914d-2f3948bf12d4 None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:44:41.525808 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad3e804c-d8e1-47b1-a419-02bb0405e03c None None] New status for floating IP e72a651a-9f3b-4b76-909c-7bd9e942f382: DOWN {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:44:41.771307 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-c54f8b60-4755-4899-ade0-6c82992f2200 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1048822809&fields=id&tenant_id=93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 267 time: 0.0320070 Sep 16 16:44:41.881448 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-c29129ce-0686-43f5-b2a6-7be30e636353 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:41.883440 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-c29129ce-0686-43f5-b2a6-7be30e636353 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 812 time: 0.1003196 Sep 16 16:44:41.897373 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-536e3120-de9c-46ef-85c3-35e4745ee8f7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/quotas/93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 375 time: 0.0084543 Sep 16 16:44:42.188028 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-af09af55-ee13-428b-b1ce-627a6abe5068 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2839286 Sep 16 16:44:42.246025 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-b1d0901e-0933-4381-99ba-4cb0132a5d83 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=93950) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 16 16:44:42.247008 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-b1d0901e-0933-4381-99ba-4cb0132a5d83 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0481012 Sep 16 16:44:42.332908 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-6529061e-e5fb-4742-b3bc-9dbaa251c836 service neutron] 10.222.0.59 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798209 Sep 16 16:44:42.420229 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-00542b2b-7eb4-4740-aa45-c8ba6068d279 service neutron] 10.222.0.59 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813622 Sep 16 16:44:42.698895 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-649a734f-aef6-4323-9952-7f11c65d9bdb req-1860f186-8a4a-4d7e-b86f-31d7aa5444db tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 210 time: 0.0255318 Sep 16 16:44:43.773468 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-da6ebd3d-6e42-4293-917e-81318b255cd5 req-cbbe2dba-fca6-49dd-b10d-56a281550aa3 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 210 time: 0.0260870 Sep 16 16:44:43.875038 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:44:43.895290 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:44:43.895641 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device 1e5ea1b7-fd2c-4b3b-87f5-bb0508014238 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:44:44.588686 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-9d005e33-b5dc-44cc-b847-1b1fe4a38bfc tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:44.590182 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-9d005e33-b5dc-44cc-b847-1b1fe4a38bfc tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 812 time: 0.1057470 Sep 16 16:44:44.632056 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-cbed4e58-6960-45b8-9cdc-f00e914c08ff tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 380 time: 0.0326581 Sep 16 16:44:44.640932 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'port': {'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'admin_state_up': True, 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'security_groups': ['c40fe4a8-7ad5-477f-a877-2cd9878b4376']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:44:44.747721 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Made reservation on behalf of 93486203e24d4fdaae53fffa4107c694 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:44:44.751099 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:44.889785 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-2e5e1aa9-1b4b-46e1-9e06-de15772bc348 req-17548385-bac1-4250-9535-9ec7e4824721 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 210 time: 0.0383978 Sep 16 16:44:44.910530 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Allocated IP 172.20.0.8 (e57ebcf9-77c9-428f-8912-3e6a36b98915/5b036f91-e26c-4294-9679-50b6b19a5acb/ed206692-5655-4baa-94ba-b38d8d787733) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:44:45.054135 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.086265 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.131233 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:44:45.134742 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:44:45.138274 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:44:45.163030 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=ed206692-5655-4baa-94ba-b38d8d787733,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:45.195759 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:45.197116 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.213058 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-95f276a2-749f-44f4-ba52-9dd2760e3613 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5756702 Sep 16 16:44:45.226060 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Request body: {'port': {'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:44:45.281782 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.420835 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-dee78a7f-0dd8-45d1-9819-9beda9889952 None None] Provisioning complete for port ed206692-5655-4baa-94ba-b38d8d787733 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:44:45.421408 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-dee78a7f-0dd8-45d1-9819-9beda9889952 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.457684 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-dee78a7f-0dd8-45d1-9819-9beda9889952 None None] Port ed206692-5655-4baa-94ba-b38d8d787733 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:44:45.536317 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ed206692-5655-4baa-94ba-b38d8d787733 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:44:45.543824 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.557023 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Transition to ACTIVE for port object ed206692-5655-4baa-94ba-b38d8d787733 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:44:45.560750 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.611319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Pushing event updated for resources: {'Port': ['ID=ed206692-5655-4baa-94ba-b38d8d787733,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:45.675568 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Attempting to bind port ed206692-5655-4baa-94ba-b38d8d787733 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:44:45.675817 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Attempting to bind port ed206692-5655-4baa-94ba-b38d8d787733 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:44:45.676188 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Attempting to bind port ed206692-5655-4baa-94ba-b38d8d787733 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:44:45.681593 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Port ed206692-5655-4baa-94ba-b38d8d787733 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:44:45.681909 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Attempting to bind port ed206692-5655-4baa-94ba-b38d8d787733 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:44:45.686707 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 44, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:44:45.687069 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Checking segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:44:45.687472 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Bound using segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:44:45.687897 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Bound port: ed206692-5655-4baa-94ba-b38d8d787733, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:44:45.688248 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.754831 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] For port ed206692-5655-4baa-94ba-b38d8d787733, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:44:45.757902 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] For port ed206692-5655-4baa-94ba-b38d8d787733, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ed206692-5655-4baa-94ba-b38d8d787733,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:44:45.761159 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.793230 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:45.793809 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:45.795176 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] 10.222.0.66 "PUT /v2.0/ports/ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 200 len: 1093 time: 0.5733936 Sep 16 16:44:45.795648 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:44:45.797855 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05" -d '{"events": [{"name": "network-changed", "server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "tag": "ed206692-5655-4baa-94ba-b38d8d787733"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:44:45.823298 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06f5ef6-a1d4-4c4c-86b9-59d6d16cf421 service neutron] Pushing event updated for resources: {'Port': ['ID=ed206692-5655-4baa-94ba-b38d8d787733,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:45.852700 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:44:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea8149c4-c1e0-4718-80dd-b2586a1a0fda x-openstack-request-id: req-ea8149c4-c1e0-4718-80dd-b2586a1a0fda {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:44:45.852899 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "tag": "ed206692-5655-4baa-94ba-b38d8d787733", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:44:45.853158 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-ea8149c4-c1e0-4718-80dd-b2586a1a0fda {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:44:45.853554 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733', 'status': 'completed', 'code': 200} Sep 16 16:44:45.886143 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-53864c04-2336-44d6-a016-15e3f8a1415a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:45.887737 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-53864c04-2336-44d6-a016-15e3f8a1415a service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1096 time: 0.0457189 Sep 16 16:44:45.934044 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-ce87246a-0468-4523-a986-6ef2bc1018af service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 200 len: 217 time: 0.0384285 Sep 16 16:44:46.012495 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-79a275dc-e0ea-40d5-af3b-a819c9032f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.013978 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-79a275dc-e0ea-40d5-af3b-a819c9032f93 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0718324 Sep 16 16:44:46.026080 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea1ec5a-9d8b-4969-bd3a-bc43a4fcbec1 req-8fcdf462-55b9-445e-b1d0-3928d5f3102e tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.026798 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:46.027510 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-eea1ec5a-9d8b-4969-bd3a-bc43a4fcbec1 req-8fcdf462-55b9-445e-b1d0-3928d5f3102e tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0596125 Sep 16 16:44:46.090714 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f4406479-9ae4-4a88-8839-746f3050c272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.092170 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-f4406479-9ae4-4a88-8839-746f3050c272 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0638325 Sep 16 16:44:46.094876 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-eea1ec5a-9d8b-4969-bd3a-bc43a4fcbec1 req-4e84ec58-d5a2-4129-af3c-b1f11fab95bb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0584245 Sep 16 16:44:46.178897 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-4eb371f0-1846-4ffe-9905-d8a5c4430927 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793655 Sep 16 16:44:46.270722 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-c95d87bb-a064-4930-9dc5-a95c6f2969e8 req-44c04d31-09fc-49d4-90f4-8dfc434a2d9d service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843282 Sep 16 16:44:46.355692 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-475a09d2-063e-4f25-b609-1f4601d892b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.357119 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-475a09d2-063e-4f25-b609-1f4601d892b9 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1096 time: 0.0396471 Sep 16 16:44:46.448486 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-0c8a0ef6-d18f-4bb1-abc0-9b04530cbe02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.449870 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-0c8a0ef6-d18f-4bb1-abc0-9b04530cbe02 service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0838003 Sep 16 16:44:46.500073 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-8cd5041b-3571-4f24-86c2-29c85be87215 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 200 len: 217 time: 0.0398650 Sep 16 16:44:46.547249 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-7b6a1544-5e51-4885-811a-f4b9c647dfc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.548614 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-7b6a1544-5e51-4885-811a-f4b9c647dfc0 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0410390 Sep 16 16:44:46.594990 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-8c25a760-d3ed-48f5-be08-a6d8fe5c1a60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:46.596421 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-8c25a760-d3ed-48f5-be08-a6d8fe5c1a60 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0413122 Sep 16 16:44:46.680949 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-88dd427a-4dd8-4dd1-a678-dc33d2c92ce3 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0762868 Sep 16 16:44:46.768025 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d3c910ae-1aa1-4c98-abeb-365f7c15cb05 req-35002e83-55ad-4a9c-b33b-f853ab6549c0 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799148 Sep 16 16:44:47.209774 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8513169c-c2da-4652-8710-62b656bd86b8 req-3d9c1467-c809-4577-b89a-d67ae0022fd6 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:47.211724 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8513169c-c2da-4652-8710-62b656bd86b8 req-3d9c1467-c809-4577-b89a-d67ae0022fd6 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0494521 Sep 16 16:44:47.251940 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-8513169c-c2da-4652-8710-62b656bd86b8 req-d3f7d4f6-499e-4b77-91cb-9576cf71a5b2 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348222 Sep 16 16:44:48.365269 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198aa920-6166-4723-9946-6be8b1efe70c req-25e32ded-f63d-42f6-8524-aa2b09cb01ef tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:48.366736 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-198aa920-6166-4723-9946-6be8b1efe70c req-25e32ded-f63d-42f6-8524-aa2b09cb01ef tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0499024 Sep 16 16:44:48.403173 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-198aa920-6166-4723-9946-6be8b1efe70c req-2e29d541-3e5e-4e5d-a32c-6eff6e33815a tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0301499 Sep 16 16:44:49.513476 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b893a3e4-254c-4c92-9165-9658ce156b55 req-703b1817-0837-4c6a-831f-157af4b5cf37 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:49.514849 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b893a3e4-254c-4c92-9165-9658ce156b55 req-703b1817-0837-4c6a-831f-157af4b5cf37 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0473452 Sep 16 16:44:49.550505 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b893a3e4-254c-4c92-9165-9658ce156b55 req-70be94c4-f204-4eeb-addd-08c449862eb8 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298352 Sep 16 16:44:50.660628 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fdb84b6-038d-4833-88e3-054bedec878c req-91936e9b-cf8f-49fb-845f-34aa8fbdc7cd tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:50.662065 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0fdb84b6-038d-4833-88e3-054bedec878c req-91936e9b-cf8f-49fb-845f-34aa8fbdc7cd tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0470791 Sep 16 16:44:50.698289 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0fdb84b6-038d-4833-88e3-054bedec878c req-d7aaeb85-34ce-492a-ae31-d2aae5b773d4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304897 Sep 16 16:44:50.745648 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-db987ce5-32d8-45fd-b838-b1f8f3aa40ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:51.807511 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8dd93b9-a90c-476e-8ed4-feb7f9b48857 req-db9da355-c7d7-4f41-9d10-4801fb7d1b89 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:51.808969 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b8dd93b9-a90c-476e-8ed4-feb7f9b48857 req-db9da355-c7d7-4f41-9d10-4801fb7d1b89 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0478153 Sep 16 16:44:51.846222 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-b8dd93b9-a90c-476e-8ed4-feb7f9b48857 req-b0392d6a-06bc-462c-9c02-c7a47e326707 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310984 Sep 16 16:44:52.966998 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0775f3-8eb7-455e-8286-0dca5db9830d req-fac27b69-1b40-4404-8652-ce5d058acb92 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:52.968456 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ea0775f3-8eb7-455e-8286-0dca5db9830d req-fac27b69-1b40-4404-8652-ce5d058acb92 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0514576 Sep 16 16:44:53.004903 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ea0775f3-8eb7-455e-8286-0dca5db9830d req-bd33298f-ebaa-429d-8d49-a30b83f75dbd tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306396 Sep 16 16:44:53.460846 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-cc39b0a2-cdb1-440e-89fc-05b9710b4dfb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:53.753344 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:53.906135 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ed206692-5655-4baa-94ba-b38d8d787733 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:44:53.997716 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ed206692-5655-4baa-94ba-b38d8d787733, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ed206692-5655-4baa-94ba-b38d8d787733,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:44:54.008452 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'ed206692-5655-4baa-94ba-b38d8d787733', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 717, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:44:54.048555 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:54.061946 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ed206692-5655-4baa-94ba-b38d8d787733 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:44:54.080778 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ed206692-5655-4baa-94ba-b38d8d787733, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ed206692-5655-4baa-94ba-b38d8d787733,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:44:54.085066 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:54.116843 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f72797e8-0351-427c-979d-4d747f241cc2 req-adfb2382-a5fd-47a4-8629-18ed7fc05083 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:54.118850 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f72797e8-0351-427c-979d-4d747f241cc2 req-adfb2382-a5fd-47a4-8629-18ed7fc05083 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 943 time: 0.0490472 Sep 16 16:44:54.132484 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=ed206692-5655-4baa-94ba-b38d8d787733,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:54.139903 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.140278 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.140626 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.140969 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.141306 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.141637 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.141965 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.142292 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.142633 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.142964 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.143312 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.143632 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:44:54.160791 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-f72797e8-0351-427c-979d-4d747f241cc2 req-54b54e9d-d273-4522-8e91-330372393bd7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0355408 Sep 16 16:44:54.298158 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['ed206692-5655-4baa-94ba-b38d8d787733'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:44:54.479789 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:55.281317 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bbdb73-34df-46c3-ac06-e478778eed7a req-b11a8e93-5b6d-44e1-be45-e87f1d7a2c4d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:55.282766 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-12bbdb73-34df-46c3-ac06-e478778eed7a req-b11a8e93-5b6d-44e1-be45-e87f1d7a2c4d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 944 time: 0.0472589 Sep 16 16:44:55.319989 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-12bbdb73-34df-46c3-ac06-e478778eed7a req-3f58b6e6-80d8-4cd2-8e73-c671dc32d08f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314376 Sep 16 16:44:55.911222 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ed206692-5655-4baa-94ba-b38d8d787733 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:44:55.958040 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port ed206692-5655-4baa-94ba-b38d8d787733 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:44:55.962058 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port ed206692-5655-4baa-94ba-b38d8d787733 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:44:55.962426 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:56.040186 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:56.061839 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:44:56.064088 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6d6be76-bfa3-46d9-aaa9-8dfbc5bbdf21" -d '{"events": [{"server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "name": "network-vif-plugged", "status": "completed", "tag": "ed206692-5655-4baa-94ba-b38d8d787733"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:44:56.077398 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port ed206692-5655-4baa-94ba-b38d8d787733, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ed206692-5655-4baa-94ba-b38d8d787733,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:44:56.081885 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:56.104671 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:44:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f85d54c7-1125-4ed5-874b-41a09636192e x-openstack-request-id: req-f85d54c7-1125-4ed5-874b-41a09636192e {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:44:56.104957 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "name": "network-vif-plugged", "status": "completed", "tag": "ed206692-5655-4baa-94ba-b38d8d787733", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:44:56.105211 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-f85d54c7-1125-4ed5-874b-41a09636192e {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:44:56.105607 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733', 'code': 200} Sep 16 16:44:56.130062 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=ed206692-5655-4baa-94ba-b38d8d787733,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:56.278637 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:56.301083 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c355aa-b2ae-4efe-a6a5-0088de5e2e3f req-d6211ef7-6885-4503-beaa-c6b2908658ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:56.302545 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-08c355aa-b2ae-4efe-a6a5-0088de5e2e3f req-d6211ef7-6885-4503-beaa-c6b2908658ce service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1098 time: 0.0391860 Sep 16 16:44:56.335895 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-08c355aa-b2ae-4efe-a6a5-0088de5e2e3f req-514de656-1b45-472e-916c-19da69cd10ea service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0262194 Sep 16 16:44:56.432539 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-902b11f5-3960-444f-b844-d0b04b0139bb req-3b1af4fb-2013-4ba6-a04c-be31dab988db tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:56.433970 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-902b11f5-3960-444f-b844-d0b04b0139bb req-3b1af4fb-2013-4ba6-a04c-be31dab988db tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 945 time: 0.0500829 Sep 16 16:44:56.469957 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-902b11f5-3960-444f-b844-d0b04b0139bb req-c2b5ee34-8219-47ea-ba88-a79161b2e337 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300250 Sep 16 16:44:57.581292 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65353d82-2c36-432c-8c06-8774ae260691 req-1063ca73-7802-4d02-b348-0e4663af90ae tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:57.582743 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-65353d82-2c36-432c-8c06-8774ae260691 req-1063ca73-7802-4d02-b348-0e4663af90ae tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 945 time: 0.0477512 Sep 16 16:44:57.619277 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-65353d82-2c36-432c-8c06-8774ae260691 req-030ece81-0d4f-4435-9225-ec22953063cb tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307546 Sep 16 16:44:57.730703 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd37680-4ce6-48fb-a8ff-c430521644f0 req-eebe790b-5215-4e8a-9ecb-84dd772269fc tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:57.732436 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bdd37680-4ce6-48fb-a8ff-c430521644f0 req-eebe790b-5215-4e8a-9ecb-84dd772269fc tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 945 time: 0.0498846 Sep 16 16:44:57.769306 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bdd37680-4ce6-48fb-a8ff-c430521644f0 req-10012f46-344c-4bcd-b11c-747737b8da7f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310214 Sep 16 16:44:57.791651 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46086) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:44:57.828618 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-066d2286-008e-461a-819d-33b50e7e3a45 tempest-TestVolumeBootPattern-96547063 tempest-TestVolumeBootPattern-96547063-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:57.830113 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-066d2286-008e-461a-819d-33b50e7e3a45 tempest-TestVolumeBootPattern-96547063 tempest-TestVolumeBootPattern-96547063-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1093 time: 0.0375419 Sep 16 16:44:57.832774 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46088) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:44:57.837373 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address': '172.20.0.8'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:44:57.858592 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:57.950593 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.050508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Allocated IP 172.27.3.62 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/3ca98f18-6c07-4fe3-95ac-bfbfd5d4dbe5) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:44:58.146780 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.178788 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.212511 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:44:58.215344 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:44:58.218757 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:44:58.252770 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=3ca98f18-6c07-4fe3-95ac-bfbfd5d4dbe5,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:58.562897 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.628312 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.767650 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.772030 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.840704 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=3ca98f18-6c07-4fe3-95ac-bfbfd5d4dbe5,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:44:58.850154 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:58.944869 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.db.l3_db [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Floating IP 63e77efd-723e-41d3-a934-ebecc0fd4bf8 associated. External IP: 172.27.3.62, port: ed206692-5655-4baa-94ba-b38d8d787733. Sep 16 16:44:59.383437 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:44:59.485828 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:44:59.496519 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:44:59.501560 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:44:59.505293 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:44:59.505894 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:44:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:59.539236 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-f3a9f204-6ee5-4d9a-aed4-ec1fdedb461b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.6940043 Sep 16 16:44:59.539236 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:44:59.539236 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8" -d '{"events": [{"name": "network-changed", "server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "tag": "ed206692-5655-4baa-94ba-b38d8d787733"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:44:59.565798 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:44:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0df8ba4c-efe9-4e5a-be3a-5e1999674b48 x-openstack-request-id: req-0df8ba4c-efe9-4e5a-be3a-5e1999674b48 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:44:59.566089 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "tag": "ed206692-5655-4baa-94ba-b38d8d787733", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:44:59.566341 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-0df8ba4c-efe9-4e5a-be3a-5e1999674b48 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:44:59.566738 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733', 'status': 'completed', 'code': 200} Sep 16 16:44:59.609660 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:44:59.625924 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-1f95a3cf-ce24-4618-aeb3-8867758f0a9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:59.627426 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-1f95a3cf-ce24-4618-aeb3-8867758f0a9e service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1098 time: 0.0394845 Sep 16 16:44:59.716508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-aa51f41d-66b9-45e1-9483-695fc93f7b84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:59.717949 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-aa51f41d-66b9-45e1-9483-695fc93f7b84 service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0837181 Sep 16 16:44:59.781703 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-7b18bf2a-e7f6-4153-a07f-e9f87f430a3f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 200 len: 998 time: 0.0557377 Sep 16 16:44:59.827808 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:44:58Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:59.830836 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-ca7190ad-5363-462d-890a-35ce1163bcad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:59.832390 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-ca7190ad-5363-462d-890a-35ce1163bcad service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0439911 Sep 16 16:44:59.853466 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:44:59.861508 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:44:59.862123 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:44:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:44:59.880367 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-f92faf50-0940-41f2-b270-95f3b57df99d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:44:59.881946 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-f92faf50-0940-41f2-b270-95f3b57df99d service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0426867 Sep 16 16:44:59.963873 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:44:59.968623 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-b1bce370-0a13-4ee4-b35e-5c24aa6cfb6c service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794506 Sep 16 16:45:00.060444 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a9b5057e-eab7-4484-85a7-cfd4d30fa4f8 req-ba2927c1-5445-4a53-b6ff-c752fcffba10 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845463 Sep 16 16:45:00.182671 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:44:58Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:45:00.209092 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81524dd9-4144-44ad-81c7-976c1532ec7a None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:44:58Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:45:00.505947 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-585d547b-fad5-436f-a6fb-1f5f3c296f9d None None] New status for floating IP 63e77efd-723e-41d3-a934-ebecc0fd4bf8: ACTIVE {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:45:11.037370 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:45:16.034182 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:20.745949 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e9ff1a1f-3192-4d93-ade4-0bc8e1e8381e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:23.461676 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-14f8d1cc-cc58-4125-bed2-a5e6491f4c17 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:23.753880 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:24.470350 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:26.280796 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:35.991006 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-551f4288-0824-4cac-9a17-5ee524bbaefe req-502dd317-e00a-41db-ac2c-d1275d6b9596 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0237923 Sep 16 16:45:36.053342 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-551f4288-0824-4cac-9a17-5ee524bbaefe req-be27c969-9306-4ffb-b719-04c3a0a26fe3 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0234172 Sep 16 16:45:36.089433 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-551f4288-0824-4cac-9a17-5ee524bbaefe req-af77a3a6-c721-4974-8a6b-7d51e00d9c22 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0180097 Sep 16 16:45:36.181120 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551f4288-0824-4cac-9a17-5ee524bbaefe req-889ca4cd-5a3d-4cef-b81e-ea5c2784392d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:45:36.182526 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-551f4288-0824-4cac-9a17-5ee524bbaefe req-889ca4cd-5a3d-4cef-b81e-ea5c2784392d service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0866542 Sep 16 16:45:46.057601 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:48.036249 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:45:50.745430 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-99e13410-e6da-46e2-ad30-806b081bddf6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:53.462092 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e2618b51-e063-4dd0-bb3f-9ba13e7d7ba0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:53.752884 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:54.474079 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:45:56.283375 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:16.057499 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:20.745364 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-8f6c6012-6c1a-4e39-90f5-85bd4667a55e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:23.466567 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d4b74dab-09b9-40f0-8861-1e899d8d7a07 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:23.753248 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:24.477106 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:25.035170 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:46:26.293515 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:33.708876 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-8ff69491-b0e1-48e2-8345-241916461989 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1048822809&fields=id&tenant_id=93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 267 time: 0.0321758 Sep 16 16:46:33.822003 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-84d1970f-6285-4310-a875-033d9714c694 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:33.823995 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-84d1970f-6285-4310-a875-033d9714c694 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 812 time: 0.1074400 Sep 16 16:46:33.838040 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-4e8173fd-b252-4179-8b0f-a70b711435c3 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/quotas/93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 375 time: 0.0085490 Sep 16 16:46:33.896379 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-a1f1d3ca-ba56-4576-bb68-c32ccb7338b7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0534441 Sep 16 16:46:34.027946 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-cf7e8d12-b890-4dbb-9e85-0109c1edde17 service neutron] 10.222.0.59 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1206713 Sep 16 16:46:34.122393 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-a025d287-1b3a-43cb-a44d-8fe25b554493 service neutron] 10.222.0.59 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884559 Sep 16 16:46:34.404855 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-894c88ed-66ce-4ee7-997b-7b137879cb2c req-d6306cec-c8e1-46f9-8316-b2f3a88f6b7a tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 210 time: 0.0277908 Sep 16 16:46:35.318082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-0642f6a6-ebdd-4bcf-bdd8-a5aa4eb38bd9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:35.319542 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-0642f6a6-ebdd-4bcf-bdd8-a5aa4eb38bd9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 812 time: 0.1066339 Sep 16 16:46:35.361197 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-5ed47ee6-5c05-4757-acd6-e393dff2eccf tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=93486203e24d4fdaae53fffa4107c694 HTTP/1.1" status: 200 len: 380 time: 0.0331562 Sep 16 16:46:35.370239 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'port': {'device_id': '90276ee5-904d-4590-84a5-1d547de23615', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'admin_state_up': True, 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'security_groups': ['c40fe4a8-7ad5-477f-a877-2cd9878b4376']}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:46:35.475394 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Made reservation on behalf of 93486203e24d4fdaae53fffa4107c694 for: {'port': 1} {{(pid=93951) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 16 16:46:35.478850 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:35.524341 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-491bd1dd-ff65-4fb8-bfff-d04faae9ba2a req-d2f163b4-e605-4537-b0db-acb827531e31 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 210 time: 0.0418327 Sep 16 16:46:35.631398 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_common [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Allocated IP 172.20.0.6 (e57ebcf9-77c9-428f-8912-3e6a36b98915/5b036f91-e26c-4294-9679-50b6b19a5acb/a32b43a0-83a3-4454-85f2-b4350ba955c3) {{(pid=93951) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:46:35.787690 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:35.821217 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_create {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:35.861442 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 is already hosted by enough agents. {{(pid=93951) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:46:35.864427 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.base_scheduler [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Resources bound (agent type, host, resource id): {{(pid=93951) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:46:35.867838 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Received port after_create {{(pid=93951) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:46:35.892669 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=a32b43a0-83a3-4454-85f2-b4350ba955c3,revision_number=1']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:35.906845 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.907194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.907552 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.907877 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.908202 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.908526 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.908848 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.909165 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.909486 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.909799 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.910112 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.910421 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:35.930681 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:35.931319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:35.945674 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-34974ce6-57c6-4be4-9dd2-33ab7a6fd0b4 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5791628 Sep 16 16:46:35.961298 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.v2.base [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Request body: {'port': {'device_id': '90276ee5-904d-4590-84a5-1d547de23615', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80588'}} {{(pid=93951) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:46:36.019449 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.058585 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-037adce4-6f98-48b3-8584-8021633bf3de None None] Provisioning complete for port a32b43a0-83a3-4454-85f2-b4350ba955c3 triggered by entity DHCP. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:46:36.059142 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-037adce4-6f98-48b3-8584-8021633bf3de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.091360 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-037adce4-6f98-48b3-8584-8021633bf3de None None] Port a32b43a0-83a3-4454-85f2-b4350ba955c3 cannot update to ACTIVE because it is not bound. {{(pid=93952) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 16 16:46:36.282135 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a32b43a0-83a3-4454-85f2-b4350ba955c3 {{(pid=93951) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:46:36.289328 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.301319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.provisioning_blocks [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Transition to ACTIVE for port object a32b43a0-83a3-4454-85f2-b4350ba955c3 will not be triggered until provisioned by entity L2. {{(pid=93951) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 16 16:46:36.305234 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.354095 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Pushing event updated for resources: {'Port': ['ID=a32b43a0-83a3-4454-85f2-b4350ba955c3,revision_number=2']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:36.422748 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Attempting to bind port a32b43a0-83a3-4454-85f2-b4350ba955c3 on host hv-cinder-80588 for vnic_type normal with profile {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 16 16:46:36.423080 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Attempting to bind port a32b43a0-83a3-4454-85f2-b4350ba955c3 by drivers openvswitch,hyperv on host hv-cinder-80588 at level 0 using segments [{'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 16 16:46:36.423461 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Attempting to bind port a32b43a0-83a3-4454-85f2-b4350ba955c3 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:46:36.427887 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Port a32b43a0-83a3-4454-85f2-b4350ba955c3 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80588 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 16 16:46:36.428208 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Attempting to bind port a32b43a0-83a3-4454-85f2-b4350ba955c3 on network e57ebcf9-77c9-428f-8912-3e6a36b98915 {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 16 16:46:36.433532 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Checking agent: {'id': 'b0333837-1486-43c1-9a85-c97fa6f31a21', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80588', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'started_at': datetime.datetime(2021, 9, 16, 16, 20, 15), 'heartbeat_timestamp': datetime.datetime(2021, 9, 16, 16, 46, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 16 16:46:36.433864 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Checking segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93951) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 16 16:46:36.434243 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Bound using segment: {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'} {{(pid=93951) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 16 16:46:36.434670 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.managers [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Bound port: a32b43a0-83a3-4454-85f2-b4350ba955c3, host: hv-cinder-80588, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ea32a20c-5996-410f-ac30-8aba1f616b9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 717, 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915'}}] {{(pid=93951) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 16 16:46:36.435028 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.498270 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] For port a32b43a0-83a3-4454-85f2-b4350ba955c3, host hv-cinder-80588, cleared binding levels {{(pid=93951) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 16 16:46:36.501831 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] For port a32b43a0-83a3-4454-85f2-b4350ba955c3, host hv-cinder-80588, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 16 16:46:36.506675 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-58361783'] for port, after_update {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.539933 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:36.540545 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:36.542053 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] 10.222.0.66 "PUT /v2.0/ports/a32b43a0-83a3-4454-85f2-b4350ba955c3 HTTP/1.1" status: 200 len: 1093 time: 0.5853798 Sep 16 16:46:36.544262 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:46:36.547178 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9" -d '{"events": [{"name": "network-changed", "server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:46:36.584650 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89abdcf-fb51-43ce-8e7d-b81d524979d2 service neutron] Pushing event updated for resources: {'Port': ['ID=a32b43a0-83a3-4454-85f2-b4350ba955c3,revision_number=3']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:36.621113 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:46:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1b86d10-d0a6-44b9-b0ba-150513dde483 x-openstack-request-id: req-a1b86d10-d0a6-44b9-b0ba-150513dde483 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:46:36.621398 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:46:36.621870 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-a1b86d10-d0a6-44b9-b0ba-150513dde483 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:46:36.622047 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'status': 'completed', 'code': 200} Sep 16 16:46:36.637633 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-9081992a-69e0-47f0-b4f7-90bf0959e5f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:36.639298 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-9081992a-69e0-47f0-b4f7-90bf0959e5f7 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 1096 time: 0.0511189 Sep 16 16:46:36.662635 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b5a125-5c25-4044-ba9f-712823d4f978 req-24de0fff-cf0d-4935-8800-9fed5afda284 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:36.664317 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-81b5a125-5c25-4044-ba9f-712823d4f978 req-24de0fff-cf0d-4935-8800-9fed5afda284 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.0505729 Sep 16 16:46:36.682992 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-05510322-b2b3-40e1-b515-40fbcc70ff90 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3 HTTP/1.1" status: 200 len: 217 time: 0.0348353 Sep 16 16:46:36.707741 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-81b5a125-5c25-4044-ba9f-712823d4f978 req-7201bc02-a185-4961-bd54-47804f4a13c2 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0355134 Sep 16 16:46:36.745867 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-8e33ceaa-b280-45cf-97a0-2f1b4ee55376 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:36.747360 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-8e33ceaa-b280-45cf-97a0-2f1b4ee55376 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0574405 Sep 16 16:46:36.798832 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551283f-8791-4b8e-aad8-b8b445a698db req-bada434e-03cb-4636-8db8-4a761a3ef421 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:36.800322 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-bada434e-03cb-4636-8db8-4a761a3ef421 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0458434 Sep 16 16:46:36.887354 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-d44980fb-a3e8-46a9-961d-59d955b2824c service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790892 Sep 16 16:46:36.977707 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d551283f-8791-4b8e-aad8-b8b445a698db req-68df39b2-60a6-4ce2-a6a0-5bef4dfb7e9e service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821447 Sep 16 16:46:37.059383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-42f64569-64d7-4985-bc62-0e332702fea0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.060822 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-42f64569-64d7-4985-bc62-0e332702fea0 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 1096 time: 0.0398309 Sep 16 16:46:37.151873 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-83f03c9e-d193-4dcc-b5fb-e0326e04f07a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.153193 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-83f03c9e-d193-4dcc-b5fb-e0326e04f07a service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0841906 Sep 16 16:46:37.192828 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-e1aaf771-3300-406b-b19c-b7bfddb1ec76 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3 HTTP/1.1" status: 200 len: 217 time: 0.0315905 Sep 16 16:46:37.240082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-c26be749-61d8-4236-9bd3-0132fc5d4343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.241456 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-c26be749-61d8-4236-9bd3-0132fc5d4343 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0410388 Sep 16 16:46:37.288885 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-6132b5f3-bf5e-41cb-bbcc-32405477d19f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.290284 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-6132b5f3-bf5e-41cb-bbcc-32405477d19f service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0416470 Sep 16 16:46:37.377178 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-a678b860-f970-48db-800d-59b4dd3d3995 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0783172 Sep 16 16:46:37.469505 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-d96d3aee-8ecc-46b8-bbc6-1b170ace92f9 req-05aaef44-71cb-4b53-80f3-bd41743480a6 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817950 Sep 16 16:46:37.593650 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-556317fe-ee93-4fc3-afd3-0b7895d25058 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0382316 Sep 16 16:46:37.652900 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a802c840-cb08-4628-af50-043cde4286fd req-90011cf2-79d2-4e36-ae35-816a98fab822 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.654312 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-90011cf2-79d2-4e36-ae35-816a98fab822 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1098 time: 0.0383022 Sep 16 16:46:37.756960 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a802c840-cb08-4628-af50-043cde4286fd req-a401b4b7-4563-4dc3-bacf-bae3cff4f93e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.758426 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-a401b4b7-4563-4dc3-bacf-bae3cff4f93e service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0847859 Sep 16 16:46:37.851592 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-9833d4f7-6765-424c-82c4-99718704c997 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 200 len: 1000 time: 0.0855014 Sep 16 16:46:37.873846 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b85fcd-50cf-4885-8856-534dfec6d9de req-393a30ed-5760-4fce-b652-b50294810496 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.875251 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a8b85fcd-50cf-4885-8856-534dfec6d9de req-393a30ed-5760-4fce-b652-b50294810496 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.1018612 Sep 16 16:46:37.923832 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a802c840-cb08-4628-af50-043cde4286fd req-dce8ef5d-d5a0-4c80-a50e-8cfb04914ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.925216 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-dce8ef5d-d5a0-4c80-a50e-8cfb04914ea6 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0662403 Sep 16 16:46:37.944634 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a8b85fcd-50cf-4885-8856-534dfec6d9de req-2e82b207-4e0d-4321-9d87-f0c8ee59aa5e tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522957 Sep 16 16:46:37.973027 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a802c840-cb08-4628-af50-043cde4286fd req-d4de6ff9-2d91-47c7-9977-c7180405a2f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:37.974519 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-d4de6ff9-2d91-47c7-9977-c7180405a2f7 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417798 Sep 16 16:46:38.063545 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-f9c75420-90f5-4587-939a-81ef3ef0cf9a service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811167 Sep 16 16:46:38.150438 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a802c840-cb08-4628-af50-043cde4286fd req-1da25af5-d873-473e-b3d6-a27879bec3d7 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798132 Sep 16 16:46:39.058496 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e343bddc-7f13-41f1-85ba-167d7ad3b881 req-b2ab2438-1d17-459a-bac2-d840a2cce6f9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:39.060013 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e343bddc-7f13-41f1-85ba-167d7ad3b881 req-b2ab2438-1d17-459a-bac2-d840a2cce6f9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.0513582 Sep 16 16:46:39.096798 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-e343bddc-7f13-41f1-85ba-167d7ad3b881 req-bd17ad5e-0e45-4abe-8510-9cc52296365b tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310683 Sep 16 16:46:40.210549 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda13af0-960d-46c2-bc77-0c922e967789 req-f12160ef-147c-494f-ac00-ba2586d5b8d5 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:40.212059 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bda13af0-960d-46c2-bc77-0c922e967789 req-f12160ef-147c-494f-ac00-ba2586d5b8d5 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.0520277 Sep 16 16:46:40.248405 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-bda13af0-960d-46c2-bc77-0c922e967789 req-e455ce67-d05d-4a25-aa1c-f819c1fe1d82 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299346 Sep 16 16:46:41.358973 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067f62cc-f7bb-4557-bc36-77f9e69c4f45 req-7514127b-b57e-4dc1-a93a-9d66c1f6a3b9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:41.360471 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-067f62cc-f7bb-4557-bc36-77f9e69c4f45 req-7514127b-b57e-4dc1-a93a-9d66c1f6a3b9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.0478661 Sep 16 16:46:41.396251 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-067f62cc-f7bb-4557-bc36-77f9e69c4f45 req-523966e0-65f0-460b-ac00-d17245a8cf76 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298324 Sep 16 16:46:42.505890 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e9a47d-f8c7-4cb9-88c5-c8a1bb12295e req-80274df9-25eb-409a-8b3b-91802c30d5bd tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:42.507239 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e3e9a47d-f8c7-4cb9-88c5-c8a1bb12295e req-80274df9-25eb-409a-8b3b-91802c30d5bd tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.0462494 Sep 16 16:46:42.543595 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-e3e9a47d-f8c7-4cb9-88c5-c8a1bb12295e req-386e80de-b6c8-434a-b017-be8e168d29b9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298197 Sep 16 16:46:43.653939 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca6e7fa-f809-45fd-bf6d-5e11b03250ed req-ea49d5db-bfe9-49f0-83ae-9100dbe3e54f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:43.655424 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2ca6e7fa-f809-45fd-bf6d-5e11b03250ed req-ea49d5db-bfe9-49f0-83ae-9100dbe3e54f tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 943 time: 0.0478702 Sep 16 16:46:43.691738 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2ca6e7fa-f809-45fd-bf6d-5e11b03250ed req-e466add7-06a7-423b-8536-3f04950bfa80 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305836 Sep 16 16:46:44.532655 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device a32b43a0-83a3-4454-85f2-b4350ba955c3 details requested by agent hyperv_hv-cinder-80588 with host hv-cinder-80588 {{(pid=93952) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 16 16:46:44.626335 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port a32b43a0-83a3-4454-85f2-b4350ba955c3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:46:44.637539 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Returning: {'device': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'port_id': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'mac_address': 'fa:16:3e:65:3e:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 717, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93952) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 16 16:46:44.677573 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:44.692263 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a32b43a0-83a3-4454-85f2-b4350ba955c3 {{(pid=93952) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 16 16:46:44.711387 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port a32b43a0-83a3-4454-85f2-b4350ba955c3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:46:44.718133 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:44.764028 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=a32b43a0-83a3-4454-85f2-b4350ba955c3,revision_number=4']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:44.771053 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.771468 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.771817 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.772155 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.772488 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.772819 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.773148 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.773476 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.773805 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.774125 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.774447 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.774767 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93952) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:44.803310 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4162ae53-29b3-4a01-a471-0450abfbb236 req-e7afbbd9-835c-4bb1-a343-f8813fdae924 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:44.805013 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4162ae53-29b3-4a01-a471-0450abfbb236 req-e7afbbd9-835c-4bb1-a343-f8813fdae924 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 944 time: 0.0479574 Sep 16 16:46:44.841205 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-4162ae53-29b3-4a01-a471-0450abfbb236 req-aecdc955-4d6f-4577-92e9-bb237a546da3 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303671 Sep 16 16:46:44.935643 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] get_ports_and_sgs() called for port_ids ['a32b43a0-83a3-4454-85f2-b4350ba955c3'] {{(pid=93952) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 16 16:46:45.954483 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55595b8d-3a76-4db3-870e-1e5bb5ad64c1 req-e315d232-cef2-45e4-98ea-58ad4c43b233 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:45.955971 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-55595b8d-3a76-4db3-870e-1e5bb5ad64c1 req-e315d232-cef2-45e4-98ea-58ad4c43b233 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 944 time: 0.0514827 Sep 16 16:46:45.993037 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-55595b8d-3a76-4db3-870e-1e5bb5ad64c1 req-a988101d-eb58-420d-9bb2-da40df957621 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312195 Sep 16 16:46:46.055670 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:46.543515 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device a32b43a0-83a3-4454-85f2-b4350ba955c3 up at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 16 16:46:46.590624 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning for port a32b43a0-83a3-4454-85f2-b4350ba955c3 completed by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 16 16:46:46.594279 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.provisioning_blocks [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Provisioning complete for port a32b43a0-83a3-4454-85f2-b4350ba955c3 triggered by entity L2. {{(pid=93952) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 16 16:46:46.594645 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-767222'] for port, provisioning_complete {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:46.669904 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:46.692031 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3'}] {{(pid=93952) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:46:46.694259 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f348fa11532d4948390a4a1127999fa2b8031ba03dfe64a64d1bb5ffd49b0f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-016e4892-225d-4575-8287-e3380b8877bb" -d '{"events": [{"server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "name": "network-vif-plugged", "status": "completed", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3"}]}' {{(pid=93952) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:46:46.706911 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.db [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] For port a32b43a0-83a3-4454-85f2-b4350ba955c3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93952) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:46:46.712513 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174'] for port, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:46.758444 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Pushing event updated for resources: {'Port': ['ID=a32b43a0-83a3-4454-85f2-b4350ba955c3,revision_number=5']} {{(pid=93952) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:46.790313 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:46:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70b0c449-d1cd-46a2-ade0-9a40633d284d x-openstack-request-id: req-70b0c449-d1cd-46a2-ade0-9a40633d284d {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:46:46.790605 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "name": "network-vif-plugged", "status": "completed", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3", "code": 200}]} {{(pid=93952) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:46:46.790857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-70b0c449-d1cd-46a2-ade0-9a40633d284d {{(pid=93952) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:46:46.791291 dv-cinder-805887-15-iscsi neutron-server[93952]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'code': 200} Sep 16 16:46:47.007653 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a093f08-ab72-41e6-a85f-9b423b0e79d5 req-bbe0d6eb-c2a9-4735-8fd9-30e1c1bdca20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:47.009072 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9a093f08-ab72-41e6-a85f-9b423b0e79d5 req-bbe0d6eb-c2a9-4735-8fd9-30e1c1bdca20 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 1098 time: 0.0417182 Sep 16 16:46:47.043352 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9a093f08-ab72-41e6-a85f-9b423b0e79d5 req-324e5355-085f-4e01-8de6-e4dd7a8dd3d9 service neutron] 10.222.0.66 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0273943 Sep 16 16:46:47.102261 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21d4f18-b4a3-4205-a258-81bc2a692d79 req-c0968050-bb55-4b37-b9c5-1a073538aa2d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:47.104264 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d21d4f18-b4a3-4205-a258-81bc2a692d79 req-c0968050-bb55-4b37-b9c5-1a073538aa2d tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 945 time: 0.0470164 Sep 16 16:46:47.140365 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-d21d4f18-b4a3-4205-a258-81bc2a692d79 req-583751a6-b549-4257-84dc-26fac7d4d607 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303674 Sep 16 16:46:48.253172 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42cbe8e0-5089-4fe0-9f40-46bfd9cf17c8 req-c8002564-8550-4fc7-b054-59c7d8dcfb20 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:48.254658 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-42cbe8e0-5089-4fe0-9f40-46bfd9cf17c8 req-c8002564-8550-4fc7-b054-59c7d8dcfb20 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 945 time: 0.0474460 Sep 16 16:46:48.291201 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-42cbe8e0-5089-4fe0-9f40-46bfd9cf17c8 req-f26a2211-ff4d-4b9d-ad4f-743f99609a33 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300450 Sep 16 16:46:48.401588 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb182a5-c0aa-4864-a444-86577d8a00a6 req-ac512470-12a9-40f7-8578-7c7f039a6462 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:48.403060 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2eb182a5-c0aa-4864-a444-86577d8a00a6 req-ac512470-12a9-40f7-8578-7c7f039a6462 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 945 time: 0.0477433 Sep 16 16:46:48.440074 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-2eb182a5-c0aa-4864-a444-86577d8a00a6 req-a65a69d0-ad58-46ec-ba01-89a367729c4c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311913 Sep 16 16:46:48.461087 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46222) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:46:48.503527 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7724393d-63f9-412a-bd4d-7128115dd8f0 tempest-TestVolumeBootPattern-96547063 tempest-TestVolumeBootPattern-96547063-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:48.505049 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7724393d-63f9-412a-bd4d-7128115dd8f0 tempest-TestVolumeBootPattern-96547063 tempest-TestVolumeBootPattern-96547063-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 1093 time: 0.0430002 Sep 16 16:46:48.507734 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46224) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:46:48.511856 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.v2.base [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Request body: {'floatingip': {'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'port_id': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address': '172.20.0.6'}} {{(pid=93950) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 16 16:46:48.532209 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:48.623713 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:48.725008 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_common [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Allocated IP 172.27.3.107 (905a8e92-0b4e-4cbe-baa3-87fc28c615ea/c21130ac-3af0-46c6-9ecc-12b38826b0d5/9b2b44a6-b2bd-45de-afe6-b220e00b2273) {{(pid=93950) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 16 16:46:48.823184 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:48.861000 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8727675176138', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:48.895043 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Network 905a8e92-0b4e-4cbe-baa3-87fc28c615ea is already hosted by enough agents. {{(pid=93950) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 16 16:46:48.897856 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.base_scheduler [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Resources bound (agent type, host, resource id): {{(pid=93950) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 16 16:46:48.901265 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Received port after_create {{(pid=93950) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 16 16:46:48.935642 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=9b2b44a6-b2bd-45de-afe6-b220e00b2273,revision_number=1']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:48.944878 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.945230 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.945566 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.945899 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.946227 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.946555 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.946880 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.947203 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.947679 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.948004 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.948324 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:48.948642 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:46:49.269999 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:49.331906 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660026'] for port, before_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:49.480414 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for port, precommit_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:49.484536 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8727675731469', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8727675176156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8727675176174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-65205991'] for port, after_update {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:49.551003 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event updated for resources: {'Port': ['ID=9b2b44a6-b2bd-45de-afe6-b220e00b2273,revision_number=2']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:46:49.562867 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-66590470'] for floatingip, after_create {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:49.660891 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Floating IP a2af739e-f84a-46ae-81c4-5d4443549e8e associated. External IP: 172.27.3.107, port: a32b43a0-83a3-4454-85f2-b4350ba955c3. Sep 16 16:46:49.857344 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:46:49.960116 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:46:49.969824 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:46:49.976150 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:49.979232 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:46:49.979927 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:46:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:46:50.003171 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-00706b7b-8703-487c-833f-c6ab9dd18dc9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.4944565 Sep 16 16:46:50.004055 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:46:50.006452 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9908cb69-72ca-46f6-a1b4-9980578cf833" -d '{"events": [{"name": "network-changed", "server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:46:50.090454 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:46:50.095106 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:46:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a218e51-9e30-4936-b6a4-61f192dc7d47 x-openstack-request-id: req-9a218e51-9e30-4936-b6a4-61f192dc7d47 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:46:50.095550 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:46:50.095806 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-9a218e51-9e30-4936-b6a4-61f192dc7d47 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:46:50.096217 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'status': 'completed', 'code': 200} Sep 16 16:46:50.156596 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-467ded1c-ee33-4665-8d7c-38a301ac82dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:50.157967 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-467ded1c-ee33-4665-8d7c-38a301ac82dd service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 1098 time: 0.0390031 Sep 16 16:46:50.249490 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-8a62d0eb-c8bc-429c-8e44-2801aebf6b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:50.250955 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-8a62d0eb-c8bc-429c-8e44-2801aebf6b1d service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.0862010 Sep 16 16:46:50.313807 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:45:00Z', 'revision_number': 1, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}, {'id': 'a2af739e-f84a-46ae-81c4-5d4443549e8e', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.107', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:65:3e:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90276ee5-904d-4590-84a5-1d547de23615', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:46:49Z', 'updated_at': '2021-09-16T16:46:49Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:46:50.314173 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-13c19fe7-d93b-4e7c-a0ee-af73c015995f service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3 HTTP/1.1" status: 200 len: 999 time: 0.0561326 Sep 16 16:46:50.339966 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:46:50.348153 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:46:50.348761 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:46:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:46:50.365831 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-3192a200-1d0b-4373-b06e-f7699b392372 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:50.367289 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-3192a200-1d0b-4373-b06e-f7699b392372 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0461133 Sep 16 16:46:50.411196 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-804f452d-2bcc-4e3d-bb32-6d529fbd3dd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:46:50.412628 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-804f452d-2bcc-4e3d-bb32-6d529fbd3dd2 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0386147 Sep 16 16:46:50.451843 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:46:50.498360 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-7df713ff-c1ba-492f-90f7-b9474b720714 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0785639 Sep 16 16:46:50.588579 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-9908cb69-72ca-46f6-a1b4-9980578cf833 req-bb5c281e-c046-4733-873e-913d9cc31703 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829184 Sep 16 16:46:50.672469 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:45:00Z', 'revision_number': 1, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}, {'id': 'a2af739e-f84a-46ae-81c4-5d4443549e8e', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.107', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:65:3e:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90276ee5-904d-4590-84a5-1d547de23615', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:46:49Z', 'updated_at': '2021-09-16T16:46:49Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:46:50.698671 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c44ce51-bc5f-4580-94c8-1885b3607a68 None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:45:00Z', 'revision_number': 1, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}, {'id': 'a2af739e-f84a-46ae-81c4-5d4443549e8e', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.107', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:65:3e:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90276ee5-904d-4590-84a5-1d547de23615', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:46:49Z', 'updated_at': '2021-09-16T16:46:49Z', 'revision_number': 0, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:46:50.745547 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2cad3d06-1566-4f20-ad84-0c04e4af5ac3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:50.869901 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5813310f-feea-4c9f-a50e-a7072f928fe1 None None] New status for floating IP a2af739e-f84a-46ae-81c4-5d4443549e8e: ACTIVE {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:46:53.471151 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ec874424-2def-4328-9865-de795daa9c47 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:53.752857 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:54.480199 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:46:56.289118 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:02.034028 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:47:16.066486 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:20.746885 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4bfd967e-8f74-4d39-a6ff-8558458e5dc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:23.464775 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-5c7c13fe-fc57-4980-abd0-df1ba4173562 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:23.754022 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:24.482763 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:26.290847 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:37.055180 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3b262312-fe39-4054-97ce-89fd486743d6 req-889d9686-19b4-4e62-b6d9-954ea3461317 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0824373 Sep 16 16:47:37.117748 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3b262312-fe39-4054-97ce-89fd486743d6 req-c88f5a0b-1d69-47a2-a973-5c32b0daac29 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0233450 Sep 16 16:47:37.156507 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3b262312-fe39-4054-97ce-89fd486743d6 req-a9e363a1-b935-4d25-bb4a-1aebaf584b70 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0188379 Sep 16 16:47:37.497739 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b262312-fe39-4054-97ce-89fd486743d6 req-e57a52fe-da5e-4319-b8d7-6301c2b3e1c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:47:37.499184 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-3b262312-fe39-4054-97ce-89fd486743d6 req-e57a52fe-da5e-4319-b8d7-6301c2b3e1c9 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3347113 Sep 16 16:47:39.033357 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:47:46.073207 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:50.747791 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e7abff26-f211-4ff1-8ea1-4bc1c4d846ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:53.466612 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-4e8838fd-410e-43bb-b66d-fb142b4a6174 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:53.754686 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:54.484970 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:47:56.295765 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:16.032238 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:48:16.084097 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.183398 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46258) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:20.397789 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Deleting port 9b2b44a6-b2bd-45de-afe6-b220e00b2273 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:20.398199 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.468941 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.469264 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.480246 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Calling delete_port for 9b2b44a6-b2bd-45de-afe6-b220e00b2273 owned by network:floatingip {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:20.624094 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.646307 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'Port': ['ID=9b2b44a6-b2bd-45de-afe6-b220e00b2273,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:20.659105 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.659487 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.659830 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.660166 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.660500 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.660830 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.661160 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.661486 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.661811 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.662135 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.662455 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.662775 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93950) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:20.718829 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.719172 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Floating IP a2af739e-f84a-46ae-81c4-5d4443549e8e disassociated (deleted). External IP: 172.27.3.107, port: a32b43a0-83a3-4454-85f2-b4350ba955c3. Sep 16 16:48:20.748531 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-e032ec1a-adba-4bc2-891f-4e81a895113c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:20.921140 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:48:21.025315 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:48:21.030587 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:21.036477 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:48:21.045868 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:21.046464 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:47:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:21.057044 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-fc8e6c4b-5428-4de4-acfd-b3e35b186350 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "DELETE /v2.0/floatingips/a2af739e-f84a-46ae-81c4-5d4443549e8e HTTP/1.1" status: 204 len: 168 time: 0.8725867 Sep 16 16:48:21.057955 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:48:21.060346 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5" -d '{"events": [{"name": "network-changed", "server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:48:21.109377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:48:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-364d5871-bafe-4c07-91b0-8522d30f86c5 x-openstack-request-id: req-364d5871-bafe-4c07-91b0-8522d30f86c5 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:48:21.109377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:48:21.109377 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-364d5871-bafe-4c07-91b0-8522d30f86c5 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:48:21.109670 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'status': 'completed', 'code': 200} Sep 16 16:48:21.157980 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:21.173514 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-84012bb7-e246-468a-bb30-06236af6d006 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:21.174998 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-84012bb7-e246-468a-bb30-06236af6d006 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 1098 time: 0.0471444 Sep 16 16:48:21.341455 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c5ff9c-19fb-418e-b3cf-b92bd8ddd918 req-fd1e48e5-b9f0-4b8d-be78-cb9f2a535622 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:21.342831 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-19c5ff9c-19fb-418e-b3cf-b92bd8ddd918 req-fd1e48e5-b9f0-4b8d-be78-cb9f2a535622 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 945 time: 0.0974226 Sep 16 16:48:21.343815 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-9461f870-9413-409c-ad0f-9514ce637cce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:21.345108 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-9461f870-9413-409c-ad0f-9514ce637cce service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.1562521 Sep 16 16:48:21.390497 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:45:00Z', 'revision_number': 1, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:21.398096 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-35f393c6-1ff5-4ae0-a983-3f063a930a29 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3 HTTP/1.1" status: 200 len: 217 time: 0.0437481 Sep 16 16:48:21.416596 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:48:21.422653 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-19c5ff9c-19fb-418e-b3cf-b92bd8ddd918 req-fc98d22e-937b-44d0-8045-c42dc4adbfc8 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740085 Sep 16 16:48:21.425446 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:21.425921 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:47:53Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:21.458802 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-de286f77-b364-4a8e-86d9-2478684d881f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:21.460297 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-de286f77-b364-4a8e-86d9-2478684d881f service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0528283 Sep 16 16:48:21.504588 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-4c450936-661d-424c-ab04-fc29552b5431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:21.506044 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-4c450936-661d-424c-ab04-fc29552b5431 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0383368 Sep 16 16:48:21.533488 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:21.596749 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-805d24f9-93e2-48df-923b-f2f067f11007 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828447 Sep 16 16:48:21.685076 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-6556daea-e39e-4ae2-a3d9-52c0aa45b8d5 req-95c9e8b3-d61e-400c-800a-ce46d68be9a6 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802920 Sep 16 16:48:21.752852 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:45:00Z', 'revision_number': 1, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:21.778763 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5281f55d-0a43-4038-822b-3094d6f93156 None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_floatingips': [{'id': '63e77efd-723e-41d3-a934-ebecc0fd4bf8', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'floating_ip_address': '172.27.3.62', 'floating_network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'router_id': '5db610f9-152a-4792-8370-68b1a1796620', 'port_id': 'ed206692-5655-4baa-94ba-b38d8d787733', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'mac_address': 'fa:16:3e:8d:ed:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-16T16:44:58Z', 'updated_at': '2021-09-16T16:45:00Z', 'revision_number': 1, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:48:21.977078 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e1d115a-9217-4666-a962-b12a191893f2 None None] New status for floating IP a2af739e-f84a-46ae-81c4-5d4443549e8e: DOWN {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:48:22.552412 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bd194d-dd7e-4d27-aa63-509539236321 req-6498c05d-4c26-49b6-b5f7-cbcb63e58043 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:22.554207 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-28bd194d-dd7e-4d27-aa63-509539236321 req-6498c05d-4c26-49b6-b5f7-cbcb63e58043 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 945 time: 0.0523844 Sep 16 16:48:22.593350 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-28bd194d-dd7e-4d27-aa63-509539236321 req-55620988-ccce-4235-9786-4f069609d595 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326135 Sep 16 16:48:22.800682 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-9db4071f-d797-4c3e-9dd2-2b8e92aafe3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:22.803067 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-9db4071f-d797-4c3e-9dd2-2b8e92aafe3c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 945 time: 0.0551639 Sep 16 16:48:22.891823 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Deleting port a32b43a0-83a3-4454-85f2-b4350ba955c3 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:22.892158 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:22.978090 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] For port a32b43a0-83a3-4454-85f2-b4350ba955c3, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=a32b43a0-83a3-4454-85f2-b4350ba955c3,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:22.978441 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:22.990154 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Calling delete_port for a32b43a0-83a3-4454-85f2-b4350ba955c3 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:23.116903 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:23.147139 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'Port': ['ID=a32b43a0-83a3-4454-85f2-b4350ba955c3,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:23.159978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.159978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.159978 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.160314 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.160480 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.160788 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.161114 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.161434 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.161758 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.162082 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.162398 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.162712 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-805887-15-iscsi {{(pid=93951) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 16 16:48:23.196012 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] No DVR routers for this DVR port a32b43a0-83a3-4454-85f2-b4350ba955c3 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:48:23.198479 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:23.200584 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-155beff1-4479-40a2-bceb-ff8d8f86804f req-8488e6cc-550f-4ce4-933d-e6425950c026 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "DELETE /v2.0/ports/a32b43a0-83a3-4454-85f2-b4350ba955c3 HTTP/1.1" status: 204 len: 173 time: 0.3909113 Sep 16 16:48:23.201016 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'name': 'network-vif-deleted', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:48:23.203306 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9005a2df-0480-4031-b5e0-9da07e402f96" -d '{"events": [{"server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "name": "network-vif-deleted", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:48:23.258500 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:48:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99db298f-5f35-401c-bae1-25014f950200 x-openstack-request-id: req-99db298f-5f35-401c-bae1-25014f950200 {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:48:23.258802 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "90276ee5-904d-4590-84a5-1d547de23615", "name": "network-vif-deleted", "tag": "a32b43a0-83a3-4454-85f2-b4350ba955c3", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:48:23.259060 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-99db298f-5f35-401c-bae1-25014f950200 {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:48:23.259493 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90276ee5-904d-4590-84a5-1d547de23615', 'name': 'network-vif-deleted', 'tag': 'a32b43a0-83a3-4454-85f2-b4350ba955c3', 'status': 'completed', 'code': 200} Sep 16 16:48:23.467707 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a87d7934-078f-43eb-9fc8-ad7b9a150e88 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:23.699782 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-1e156b02-fff1-49cf-84b4-bb38be723d4e req-bb054407-d6de-4571-a9c2-c6687c3309dd tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=90276ee5-904d-4590-84a5-1d547de23615 HTTP/1.1" status: 200 len: 210 time: 0.0263681 Sep 16 16:48:23.756065 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:24.487450 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:24.915535 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device a32b43a0-83a3-4454-85f2-b4350ba955c3 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:24.938625 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: a32b43a0-83a3-4454-85f2-b4350ba955c3 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:24.938965 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device a32b43a0-83a3-4454-85f2-b4350ba955c3 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:26.421219 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:26.962640 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46306) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:27.112047 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Deleting port 3ca98f18-6c07-4fe3-95ac-bfbfd5d4dbe5 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:27.112387 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:27.187513 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:27.187842 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:27.200432 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Calling delete_port for 3ca98f18-6c07-4fe3-95ac-bfbfd5d4dbe5 owned by network:floatingip {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:27.345435 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:27.371922 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'Port': ['ID=3ca98f18-6c07-4fe3-95ac-bfbfd5d4dbe5,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:27.427448 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:27.428043 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.db.l3_db [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Floating IP 63e77efd-723e-41d3-a934-ebecc0fd4bf8 disassociated (deleted). External IP: 172.27.3.62, port: ed206692-5655-4baa-94ba-b38d8d787733. Sep 16 16:48:27.853506 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:48:27.958923 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:48:27.963703 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:27.968035 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:48:27.976652 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:27.977274 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:48:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:27.989744 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-18f2e8f0-43b7-4e78-8baa-5f9b74aa062c tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "DELETE /v2.0/floatingips/63e77efd-723e-41d3-a934-ebecc0fd4bf8 HTTP/1.1" status: 204 len: 168 time: 1.0259938 Sep 16 16:48:27.990343 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733'}] {{(pid=93950) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:48:27.992610 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ab39bf05529f5d40a54c098dc294943e6cd688ab06ba3dbab7a8638dfcdc82f3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22b508bc-e600-45d1-9345-bf29e42e433d" -d '{"events": [{"name": "network-changed", "server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "tag": "ed206692-5655-4baa-94ba-b38d8d787733"}]}' {{(pid=93950) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:48:28.027902 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 16 Sep 2021 16:48:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25dfcec6-6aca-4f63-9d5d-e12a67e35fb4 x-openstack-request-id: req-25dfcec6-6aca-4f63-9d5d-e12a67e35fb4 {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:48:28.028229 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "tag": "ed206692-5655-4baa-94ba-b38d8d787733", "status": "completed", "code": 200}]} {{(pid=93950) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:48:28.028443 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-25dfcec6-6aca-4f63-9d5d-e12a67e35fb4 {{(pid=93950) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:48:28.028866 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733', 'status': 'completed', 'code': 200} Sep 16 16:48:28.087382 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:28.097274 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b508bc-e600-45d1-9345-bf29e42e433d req-c2496463-146f-4395-be9a-6885bbe7df11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:28.098874 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-c2496463-146f-4395-be9a-6885bbe7df11 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=93486203e24d4fdaae53fffa4107c694&device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 1098 time: 0.0454915 Sep 16 16:48:28.233710 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b508bc-e600-45d1-9345-bf29e42e433d req-6a8cce6f-4697-4956-b24a-c9bbebb1ee69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:28.235174 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-6a8cce6f-4697-4956-b24a-c9bbebb1ee69 service neutron] 10.222.0.66 "GET /v2.0/networks?id=e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 200 len: 913 time: 0.1252789 Sep 16 16:48:28.243197 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecb0665-15cc-4469-8925-0b277d697ee8 req-bb5d1690-bd42-4e65-9717-2c9b4e106948 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:28.244583 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8ecb0665-15cc-4469-8925-0b277d697ee8 req-bb5d1690-bd42-4e65-9717-2c9b4e106948 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 945 time: 0.0696740 Sep 16 16:48:28.284054 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-0e6ac5a7-b93f-42e7-982d-7c1dbf4a40f2 service neutron] 10.222.0.66 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 200 len: 217 time: 0.0385659 Sep 16 16:48:28.291320 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:28.321592 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:48:28.329723 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:28.330323 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:48:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:28.342227 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-8ecb0665-15cc-4469-8925-0b277d697ee8 req-e6532fc9-4df4-46fd-a677-9cc89444c1c0 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0898705 Sep 16 16:48:28.353129 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b508bc-e600-45d1-9345-bf29e42e433d req-412416d4-50fb-4cff-9003-1c486e8399f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:28.357741 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-412416d4-50fb-4cff-9003-1c486e8399f5 service neutron] 10.222.0.66 "GET /v2.0/subnets?id=5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 200 len: 851 time: 0.0621226 Sep 16 16:48:28.403046 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b508bc-e600-45d1-9345-bf29e42e433d req-3de655e2-5711-476d-8b57-535fc21e1615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:28.404431 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-3de655e2-5711-476d-8b57-535fc21e1615 service neutron] 10.222.0.66 "GET /v2.0/ports?network_id=e57ebcf9-77c9-428f-8912-3e6a36b98915&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0388994 Sep 16 16:48:28.436477 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:28.496383 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-659aecff-5d6e-49e9-a3a4-b2cfcf95cb21 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830028 Sep 16 16:48:28.589073 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-22b508bc-e600-45d1-9345-bf29e42e433d req-aa9b6cb2-2258-4fa8-a190-3de46beb46c8 service neutron] 10.222.0.66 "GET /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852656 Sep 16 16:48:28.631651 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:28.657790 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db465348-90bf-4f85-875c-c6cb3b02450c None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:02Z', 'revision_number': 4, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi', '_interfaces': [{'id': '33b824fd-e154-48b4-8880-28c47f312fa9', 'name': '', 'network_id': 'e57ebcf9-77c9-428f-8912-3e6a36b98915', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'mac_address': 'fa:16:3e:39:60:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:01Z', 'updated_at': '2021-09-16T16:42:06Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'subnets': [{'id': '5b036f91-e26c-4294-9679-50b6b19a5acb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:48:28.871522 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd6d38bf-9b50-4c83-b845-da07bee0f7dc None None] New status for floating IP 63e77efd-723e-41d3-a934-ebecc0fd4bf8: DOWN {{(pid=93953) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 16 16:48:29.463129 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46cb36-b9a2-421d-9814-782efe2e88fd req-d3a39d87-32e3-458e-ba99-20a7a4bc0dc7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93950) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:29.464555 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-db46cb36-b9a2-421d-9814-782efe2e88fd req-d3a39d87-32e3-458e-ba99-20a7a4bc0dc7 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 945 time: 0.0512791 Sep 16 16:48:29.501235 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-db46cb36-b9a2-421d-9814-782efe2e88fd req-18a38782-1963-41d4-b7b3-371f45d2c5fc tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/security-groups?id=c40fe4a8-7ad5-477f-a877-2cd9878b4376&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309362 Sep 16 16:48:29.660732 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-9d7d9751-6db5-4068-94ec-d4d3f10b14ac tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:48:29.662136 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-9d7d9751-6db5-4068-94ec-d4d3f10b14ac tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 945 time: 0.0461941 Sep 16 16:48:29.752520 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Deleting port ed206692-5655-4baa-94ba-b38d8d787733 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:29.752774 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:29.838771 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] For port ed206692-5655-4baa-94ba-b38d8d787733, host hv-cinder-80588, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80588',level=0,port_id=ed206692-5655-4baa-94ba-b38d8d787733,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:29.839127 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:29.850907 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Calling delete_port for ed206692-5655-4baa-94ba-b38d8d787733 owned by compute:nova {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:29.973317 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:30.006532 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'Port': ['ID=ed206692-5655-4baa-94ba-b38d8d787733,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:30.045027 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] No DVR routers for this DVR port ed206692-5655-4baa-94ba-b38d8d787733 on host hv-cinder-80588 {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:48:30.047528 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for port, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:30.049467 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-a54ed0c2-d67f-473a-a65b-3c52f48b9f7f req-c5b5b765-8dd9-47cb-a83e-2ae3e83e1c75 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.66 "DELETE /v2.0/ports/ed206692-5655-4baa-94ba-b38d8d787733 HTTP/1.1" status: 204 len: 173 time: 0.3812492 Sep 16 16:48:30.049910 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'name': 'network-vif-deleted', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733'}] {{(pid=93951) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 16 16:48:30.052134 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.59/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09ea9a818338233b2d6b6b019500595c6eabde8207bffe73bd794b3bdab4e171" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf8d02a1-b44b-44a2-933b-82ea47379b53" -d '{"events": [{"server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "name": "network-vif-deleted", "tag": "ed206692-5655-4baa-94ba-b38d8d787733"}]}' {{(pid=93951) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 16 16:48:30.091527 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 16 Sep 2021 16:48:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6dcefcf5-1480-4fb0-9c89-14ede135545e x-openstack-request-id: req-6dcefcf5-1480-4fb0-9c89-14ede135545e {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 16 16:48:30.091527 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7f4d51f-d2f2-4fee-80bb-78eccac22280", "name": "network-vif-deleted", "tag": "ed206692-5655-4baa-94ba-b38d8d787733", "status": "completed", "code": 200}]} {{(pid=93951) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 16 16:48:30.091793 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.59/compute/v2.1/os-server-external-events used request id req-6dcefcf5-1480-4fb0-9c89-14ede135545e {{(pid=93951) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 16 16:48:30.091997 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7f4d51f-d2f2-4fee-80bb-78eccac22280', 'name': 'network-vif-deleted', 'tag': 'ed206692-5655-4baa-94ba-b38d8d787733', 'status': 'completed', 'code': 200} Sep 16 16:48:30.609636 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [req-29ac7189-19ef-43de-a9fc-5472ef5c7c9c req-b2454112-1e3b-45ba-bc44-8fd16f686485 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "GET /v2.0/ports?device_id=c7f4d51f-d2f2-4fee-80bb-78eccac22280 HTTP/1.1" status: 200 len: 210 time: 0.0323551 Sep 16 16:48:31.664331 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46322) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:31.790377 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Deleting port 6d348f29-7421-473f-ab7c-b295ca970ab1 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:31.790705 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:31.865488 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:31.865814 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:31.877632 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Calling delete_port for 6d348f29-7421-473f-ab7c-b295ca970ab1 owned by network:floatingip {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:32.001342 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:32.026792 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'Port': ['ID=6d348f29-7421-473f-ab7c-b295ca970ab1,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:32.093326 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for floatingip, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:32.095958 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-48230'] for floatingip, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:32.097102 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-92c608b9-4d2d-4b94-afc1-34b8d50e5080 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "DELETE /v2.0/floatingips/e72a651a-9f3b-4b76-909c-7bd9e942f382 HTTP/1.1" status: 204 len: 168 time: 0.4318049 Sep 16 16:48:32.962042 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ed206692-5655-4baa-94ba-b38d8d787733 no longer exists at agent hyperv_hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:32.984927 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] No Port match for: ed206692-5655-4baa-94ba-b38d8d787733 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:32.985281 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Device ed206692-5655-4baa-94ba-b38d8d787733 not bound to the agent host hv-cinder-80588 {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:33.286508 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46334) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:33.342498 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eb2168d5-0e4a-4302-9006-af931a2194a9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:33.366606 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eb2168d5-0e4a-4302-9006-af931a2194a9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:33.422943 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eb2168d5-0e4a-4302-9006-af931a2194a9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:33.425486 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-eb2168d5-0e4a-4302-9006-af931a2194a9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:33.426625 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-eb2168d5-0e4a-4302-9006-af931a2194a9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] 10.222.0.59 "DELETE /v2.0/security-groups/c40fe4a8-7ad5-477f-a877-2cd9878b4376 HTTP/1.1" status: 204 len: 168 time: 0.1391420 Sep 16 16:48:33.436903 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2168d5-0e4a-4302-9006-af931a2194a9 tempest-TestVolumeBootPattern-1285670865 tempest-TestVolumeBootPattern-1285670865-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c40fe4a8-7ad5-477f-a877-2cd9878b4376,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:33.477285 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46338) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:33.904441 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:34.136683 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Deleting port 33b824fd-e154-48b4-8880-28c47f312fa9 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:34.137533 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:34.212465 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] For port 33b824fd-e154-48b4-8880-28c47f312fa9, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=33b824fd-e154-48b4-8880-28c47f312fa9,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:34.212866 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:34.229266 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Calling delete_port for 33b824fd-e154-48b4-8880-28c47f312fa9 owned by network:router_interface {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:34.399772 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:34.425826 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Pushing event deleted for resources: {'Port': ['ID=33b824fd-e154-48b4-8880-28c47f312fa9,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:34.584255 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:34.788319 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Router 5db610f9-152a-4792-8370-68b1a1796620 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93951) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:48:35.135962 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93951) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:48:35.141553 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-e3a7c136-2988-4bee-b955-9ec459ee001a admin admin] 10.222.0.59 "PUT /v2.0/routers/5db610f9-152a-4792-8370-68b1a1796620/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6633143 Sep 16 16:48:35.144046 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46342) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:35.144958 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] Sync routers for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:48:35.154766 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:35.155398 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:48:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:35.245077 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks [] for router, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.255274 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:35.344099 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.394607 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Deleting port 18d653ce-8e71-47e1-8037-64ea3d0bea94 {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:35.394847 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.425185 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129'}], 'enable_snat': True}, 'gw_port_id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:48:34Z', 'revision_number': 5, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port': {'id': '18d653ce-8e71-47e1-8037-64ea3d0bea94', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:44:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5db610f9-152a-4792-8370-68b1a1796620', 'device_owner': 'network:router_gateway', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:42:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:35.451910 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] Checking router: 5db610f9-152a-4792-8370-68b1a1796620 for host: dv-cinder-805887-15-iscsi {{(pid=93952) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:48:35.459971 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] Routers {'5db610f9-152a-4792-8370-68b1a1796620'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93952) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:35.460579 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:48:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['5db610f9-152a-4792-8370-68b1a1796620'], 'active': True} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:35.469389 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] For port 18d653ce-8e71-47e1-8037-64ea3d0bea94, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=18d653ce-8e71-47e1-8037-64ea3d0bea94,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:35.469884 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.485662 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Calling delete_port for 18d653ce-8e71-47e1-8037-64ea3d0bea94 owned by network:router_gateway {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:35.544972 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_dvr_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] Set router 5db610f9-152a-4792-8370-68b1a1796620 gateway port host: None {{(pid=93952) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:35.648811 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.673148 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Pushing event deleted for resources: {'Port': ['ID=18d653ce-8e71-47e1-8037-64ea3d0bea94,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:35.732002 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.db.l3_hamode_db [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:48:35Z', 'revision_number': 6, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93952) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:35.735178 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.759106 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f46ba2e0-5edb-4198-8186-9afc314ffd32 None None] The sync data for ids ['5db610f9-152a-4792-8370-68b1a1796620'] in dv-cinder-805887-15-iscsi is: [{'id': '5db610f9-152a-4792-8370-68b1a1796620', 'name': 'tempest-TestVolumeBootPattern-1411048628-router', 'tenant_id': '93486203e24d4fdaae53fffa4107c694', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:41:59Z', 'updated_at': '2021-09-16T16:48:35Z', 'revision_number': 6, 'project_id': '93486203e24d4fdaae53fffa4107c694', 'gw_port_host': None}] {{(pid=93952) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:48:35.823258 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.825334 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.870271 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.870818 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5db610f9-152a-4792-8370-68b1a1796620 {{(pid=93951) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:48:35.875940 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] Notify callbacks [] for router, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.877141 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-924df217-ada3-4bb6-9f21-694d62b9dff2 admin admin] 10.222.0.59 "DELETE /v2.0/routers/5db610f9-152a-4792-8370-68b1a1796620 HTTP/1.1" status: 204 len: 168 time: 0.7321672 Sep 16 16:48:35.879789 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46344) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:35.921899 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.db_base_plugin_v2 [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Deleting subnet 5b036f91-e26c-4294-9679-50b6b19a5acb {{(pid=93951) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:48:35.924714 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:35.958060 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-58472601'] for subnet, precommit_delete_associations {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.035852 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.085534 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-58361729', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58434304'] for subnet, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.110007 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5b036f91-e26c-4294-9679-50b6b19a5acb,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:36.116421 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] Notify callbacks [] for subnet, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.118389 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-03ce7df3-43f3-4b82-993a-7198ddb98d9e admin admin] 10.222.0.59 "DELETE /v2.0/subnets/5b036f91-e26c-4294-9679-50b6b19a5acb HTTP/1.1" status: 204 len: 168 time: 0.2376413 Sep 16 16:48:36.120791 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46346) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:36.122100 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-296bf797-0c80-48e8-9082-ea5ec332d026 None None] Network e57ebcf9-77c9-428f-8912-3e6a36b98915 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:48:36.190007 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.248917 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Deleting port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e {{(pid=93951) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:36.249259 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.311428 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.db [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] For port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,segment=NetworkSegment(ea32a20c-5996-410f-ac30-8aba1f616b9b),segment_id=ea32a20c-5996-410f-ac30-8aba1f616b9b)] {{(pid=93951) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:36.311808 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.323348 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.plugin [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Calling delete_port for 6671198d-4d7f-4fcc-89f4-8bccfc90b94e owned by network:dhcp {{(pid=93951) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:36.400295 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-58361774'] for port, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.424340 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Pushing event deleted for resources: {'Port': ['ID=6671198d-4d7f-4fcc-89f4-8bccfc90b94e,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:36.428879 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.db.l3_dvrscheduler_db [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] No DVR routers for this DVR port 6671198d-4d7f-4fcc-89f4-8bccfc90b94e on host dv-cinder-805887-15-iscsi {{(pid=93951) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:48:36.497491 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cc5eadb-d5b6-4725-a38e-90f76aab1619 None None] DHCP port deletion for e57ebcf9-77c9-428f-8912-3e6a36b98915 request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:48:36.517300 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.537692 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e57ebcf9-77c9-428f-8912-3e6a36b98915']}} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:36.547055 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ea32a20c-5996-410f-ac30-8aba1f616b9b') {'for_net_delete': True} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:36.547383 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.services.segments.db [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ea32a20c-5996-410f-ac30-8aba1f616b9b') {} {{(pid=93951) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:36.556709 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-58472594'] for segment, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.559312 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 33b824fd-e154-48b4-8880-28c47f312fa9 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:36.570043 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.576136 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Releasing vlan 717 on physical network physnet1 to pool {{(pid=93951) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:48:36.576557 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-58360159'] for segment, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: Traceback (most recent call last): Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: timer() Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: cb(*args, **kw) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: return func(*args, **kwargs) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: self._notify() Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: self.callback(batched_events) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: event.method(event) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: return f(self, *a, **k) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._get(url).json() Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: return self.request(url, 'GET', **kwargs) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:48:36.578744 dv-cinder-805887-15-iscsi neutron-server[93951]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:48:36.581070 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 33b824fd-e154-48b4-8880-28c47f312fa9 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:36.581070 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 33b824fd-e154-48b4-8880-28c47f312fa9 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:36.581070 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 18d653ce-8e71-47e1-8037-64ea3d0bea94 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:36.601381 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 18d653ce-8e71-47e1-8037-64ea3d0bea94 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:36.601731 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 18d653ce-8e71-47e1-8037-64ea3d0bea94 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:36.602145 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 6671198d-4d7f-4fcc-89f4-8bccfc90b94e no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:36.624509 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 6671198d-4d7f-4fcc-89f4-8bccfc90b94e {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:36.624847 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 6671198d-4d7f-4fcc-89f4-8bccfc90b94e not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:36.640162 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.645913 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:36.648116 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] 10.222.0.59 "DELETE /v2.0/networks/e57ebcf9-77c9-428f-8912-3e6a36b98915 HTTP/1.1" status: 204 len: 168 time: 0.5262325 Sep 16 16:48:36.651596 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46348) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:36.659822 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111dd3b2-0fbc-4c77-9d38-9ffdd4b9beca admin admin] Pushing event deleted for resources: {'Network': ['ID=e57ebcf9-77c9-428f-8912-3e6a36b98915,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:36.991150 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-66588934'] for router_interface, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:37.228925 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Deleting port 24b4a270-d20d-46a0-b8c2-12459c796e77 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:37.229263 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:37.304115 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] For port 24b4a270-d20d-46a0-b8c2-12459c796e77, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=24b4a270-d20d-46a0-b8c2-12459c796e77,segment=NetworkSegment(07223bae-0998-49fc-b357-0fbbf1d30e53),segment_id=07223bae-0998-49fc-b357-0fbbf1d30e53)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:37.304386 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:37.319899 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Calling delete_port for 24b4a270-d20d-46a0-b8c2-12459c796e77 owned by network:router_interface {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:37.490537 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:37.516066 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Pushing event deleted for resources: {'Port': ['ID=24b4a270-d20d-46a0-b8c2-12459c796e77,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:37.676856 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-66587572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-66590646'] for router_interface, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:37.889538 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Router 7b2e2b0d-3e39-4664-997b-e172450a98b1 has already been hosted by L3 agent 10c3ba41-cee2-4adb-9470-62878361ebb1 {{(pid=93950) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 16 16:48:37.994720 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] Notify agent at l3_agent.dv-cinder-805887-15-iscsi the message routers_updated {{(pid=93950) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 16 16:48:38.000095 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-7962595f-5180-40f5-9130-b45468dbd00f admin admin] 10.222.0.59 "PUT /v2.0/routers/7b2e2b0d-3e39-4664-997b-e172450a98b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3468571 Sep 16 16:48:38.002589 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46350) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:38.005188 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] Sync routers for ids ['7b2e2b0d-3e39-4664-997b-e172450a98b1'] in dv-cinder-805887-15-iscsi {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 16 16:48:38.014895 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] Routers {'7b2e2b0d-3e39-4664-997b-e172450a98b1'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:38.015525 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:48:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['7b2e2b0d-3e39-4664-997b-e172450a98b1'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:38.103753 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks [] for router, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.115979 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] Set router 7b2e2b0d-3e39-4664-997b-e172450a98b1 gateway port host: dv-cinder-805887-15-iscsi {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:38.223131 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.274528 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Deleting port d8b8287c-d4c4-4fd2-b75b-10350976edec {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:38.274873 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.349845 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] For port d8b8287c-d4c4-4fd2-b75b-10350976edec, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=d8b8287c-d4c4-4fd2-b75b-10350976edec,segment=NetworkSegment(68cf5864-2803-4fc0-948e-ca8c09944282),segment_id=68cf5864-2803-4fc0-948e-ca8c09944282)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:38.350236 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.366287 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Calling delete_port for d8b8287c-d4c4-4fd2-b75b-10350976edec owned by network:router_gateway {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:38.376439 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'external_fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115'}], 'enable_snat': True}, 'gw_port_id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:48:37Z', 'revision_number': 5, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port': {'id': 'd8b8287c-d4c4-4fd2-b75b-10350976edec', 'name': '', 'network_id': '905a8e92-0b4e-4cbe-baa3-87fc28c615ea', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:f1:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 681, 'fixed_ips': [{'subnet_id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'ip_address': '172.27.3.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-805887-15-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-16T16:42:04Z', 'updated_at': '2021-09-16T16:42:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'c21130ac-3af0-46c6-9ecc-12b38826b0d5', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-805887-15-iscsi'}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:38.401714 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] Checking router: 7b2e2b0d-3e39-4664-997b-e172450a98b1 for host: dv-cinder-805887-15-iscsi {{(pid=93953) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 16 16:48:38.409654 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvrscheduler_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] Routers {'7b2e2b0d-3e39-4664-997b-e172450a98b1'} bound to L3 agent in host dv-cinder-805887-15-iscsi {{(pid=93953) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 16 16:48:38.410254 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-805887-15-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-16T16:14:23Z,description=,heartbeat_timestamp=2021-09-16T16:48:23Z,host='dv-cinder-805887-15-iscsi',id=10c3ba41-cee2-4adb-9470-62878361ebb1,load=0,resource_versions=,resources_synced=,started_at=2021-09-16T16:14:23Z,topic='l3_agent')) {'router_ids': ['7b2e2b0d-3e39-4664-997b-e172450a98b1'], 'active': True} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:38.495607 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_dvr_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] Set router 7b2e2b0d-3e39-4664-997b-e172450a98b1 gateway port host: None {{(pid=93953) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 16 16:48:38.533801 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.549630 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.l3_hamode_db [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:48:38Z', 'revision_number': 6, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port_host': None}], 'dv-cinder-805887-15-iscsi', False) {} {{(pid=93953) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:38.563990 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Pushing event deleted for resources: {'Port': ['ID=d8b8287c-d4c4-4fd2-b75b-10350976edec,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:38.576038 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-477fbe02-a867-4d5f-85fe-cf9df636c874 None None] The sync data for ids ['7b2e2b0d-3e39-4664-997b-e172450a98b1'] in dv-cinder-805887-15-iscsi is: [{'id': '7b2e2b0d-3e39-4664-997b-e172450a98b1', 'name': 'tempest-TestVolumeBootPattern-1306288140-router', 'tenant_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-16T16:42:03Z', 'updated_at': '2021-09-16T16:48:38Z', 'revision_number': 6, 'project_id': 'ef0c7fd8a0c94b85aa7943fb6a4897bf', 'gw_port_host': None}] {{(pid=93953) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 16 16:48:38.624399 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-66590576'] for router_gateway, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.709980 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-66589217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6640'] for router, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.712003 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.752089 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-66589402'] for router, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.752529 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7b2e2b0d-3e39-4664-997b-e172450a98b1 {{(pid=93950) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 16 16:48:38.757606 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] Notify callbacks [] for router, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.758792 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-15512f22-89ef-4078-952d-2a5156db1ba4 admin admin] 10.222.0.59 "DELETE /v2.0/routers/7b2e2b0d-3e39-4664-997b-e172450a98b1 HTTP/1.1" status: 204 len: 168 time: 0.7552745 Sep 16 16:48:38.761257 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46352) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:38.808213 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.db_base_plugin_v2 [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Deleting subnet ad0caa3f-075e-4c66-b69f-f505db8ced7b {{(pid=93950) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 16 16:48:38.811095 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.845099 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64152849'] for subnet, precommit_delete_associations {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.921700 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-754314'] for subnet, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:38.981960 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-754333', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66676084', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-65205969', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64151703'] for subnet, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.008708 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ad0caa3f-075e-4c66-b69f-f505db8ced7b,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:39.012232 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for subnet, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.014076 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-3f534d36-c9fa-4f1f-a1f7-806130cad12f admin admin] 10.222.0.59 "DELETE /v2.0/subnets/ad0caa3f-075e-4c66-b69f-f505db8ced7b HTTP/1.1" status: 204 len: 168 time: 0.2514081 Sep 16 16:48:39.016542 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.wsgi [-] (93950) accepted ('10.222.0.59', 46354) {{(pid=93950) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:39.018164 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e822a854-b86e-4542-a76a-7c3931c68f97 None None] Network a5f6af0e-b483-43d5-abe1-1da0708c4562 requested from dv-cinder-805887-15-iscsi {{(pid=93952) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 16 16:48:39.081568 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-580475'] for network, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.138987 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Deleting port 265aca19-5d32-4586-afe0-25976e844af6 {{(pid=93950) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 16 16:48:39.139357 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8727675724337'] for port, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.203339 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.db [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] For port 265aca19-5d32-4586-afe0-25976e844af6, host dv-cinder-805887-15-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-805887-15-iscsi',level=0,port_id=265aca19-5d32-4586-afe0-25976e844af6,segment=NetworkSegment(07223bae-0998-49fc-b357-0fbbf1d30e53),segment_id=07223bae-0998-49fc-b357-0fbbf1d30e53)] {{(pid=93950) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 16 16:48:39.203735 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-66714190'] for port, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.217228 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.plugin [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Calling delete_port for 265aca19-5d32-4586-afe0-25976e844af6 owned by network:dhcp {{(pid=93950) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 16 16:48:39.299308 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660091', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-247117', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8727675731191', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8727675176147', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-65206014'] for port, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.311153 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-feb6938c-434e-437b-bc7f-82c492dea64b None None] DHCP port deletion for a5f6af0e-b483-43d5-abe1-1da0708c4562 request from dv-cinder-805887-15-iscsi {{(pid=93952) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 16 16:48:39.331550 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=265aca19-5d32-4586-afe0-25976e844af6,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:39.335024 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] No DVR routers for this DVR port 265aca19-5d32-4586-afe0-25976e844af6 on host dv-cinder-805887-15-iscsi {{(pid=93950) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 16 16:48:39.404989 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-753677', 'neutron.services.segments.db._delete_segments_for_network-8727675478173'] for network, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.429350 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a5f6af0e-b483-43d5-abe1-1da0708c4562']}} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:39.439112 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '07223bae-0998-49fc-b357-0fbbf1d30e53') {'for_net_delete': True} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:39.439439 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.services.segments.db [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '07223bae-0998-49fc-b357-0fbbf1d30e53') {} {{(pid=93950) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 16 16:48:39.448473 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8727675478950', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64152858'] for segment, before_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.461105 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631'] for segment, precommit_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.466875 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Releasing vlan 720 on physical network physnet1 to pool {{(pid=93950) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 16 16:48:39.467305 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-761631', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-65204239'] for segment, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: Traceback (most recent call last): Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: timer() Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: cb(*args, **kw) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: return func(*args, **kwargs) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: self._notify() Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: self.callback(batched_events) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: event.method(event) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: aggregate_uuid = self.p_client.list_aggregates( Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: return f(self, *a, **k) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._get(url).json() Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: return self.request(url, 'GET', **kwargs) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: base_url = self.get_endpoint(auth, allow=allow, Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 16 16:48:39.468969 dv-cinder-805887-15-iscsi neutron-server[93950]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 16 16:48:39.525574 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-753684', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66675968', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-66598727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-66590484'] for network, after_delete {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.531524 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron_lib.callbacks.manager [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-66598741'] for network, before_response {{(pid=93950) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.535937 dv-cinder-805887-15-iscsi neutron-server[93950]: INFO neutron.wsgi [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] 10.222.0.59 "DELETE /v2.0/networks/a5f6af0e-b483-43d5-abe1-1da0708c4562 HTTP/1.1" status: 204 len: 168 time: 0.5160046 Sep 16 16:48:39.544707 dv-cinder-805887-15-iscsi neutron-server[93950]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec1b33d6-c00e-4fae-9f0a-a4d75851e4e9 admin admin] Pushing event deleted for resources: {'Network': ['ID=a5f6af0e-b483-43d5-abe1-1da0708c4562,revision_number=None']} {{(pid=93950) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:39.641917 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46358) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:39.682128 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-0c810e80-6b6b-493d-be7d-dfdc8c0613f4 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=93486203e24d4fdaae53fffa4107c694&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0390649 Sep 16 16:48:39.684736 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46360) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:39.734308 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fcf7370-c8a2-4e53-9dfc-1bac01c56b88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.754211 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fcf7370-c8a2-4e53-9dfc-1bac01c56b88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.799522 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fcf7370-c8a2-4e53-9dfc-1bac01c56b88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.801995 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2fcf7370-c8a2-4e53-9dfc-1bac01c56b88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:39.803428 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2fcf7370-c8a2-4e53-9dfc-1bac01c56b88 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9ad38843-53c7-4642-bcef-3480047e82f3 HTTP/1.1" status: 204 len: 168 time: 0.1177609 Sep 16 16:48:39.818387 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcf7370-c8a2-4e53-9dfc-1bac01c56b88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ad38843-53c7-4642-bcef-3480047e82f3,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:40.113335 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46366) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:40.151145 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-573610ab-a9af-45ae-ae45-48d33042dd50 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ef0c7fd8a0c94b85aa7943fb6a4897bf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0367093 Sep 16 16:48:40.153897 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.wsgi [-] (93951) accepted ('10.222.0.59', 46368) {{(pid=93951) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 16 16:48:40.198865 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2abcbb55-a994-46a4-8538-c70ed31728f9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:40.220779 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2abcbb55-a994-46a4-8538-c70ed31728f9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:40.264878 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2abcbb55-a994-46a4-8538-c70ed31728f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-66678739'] for security_group, after_delete {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:40.267439 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron_lib.callbacks.manager [None req-2abcbb55-a994-46a4-8538-c70ed31728f9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93951) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:40.268575 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [None req-2abcbb55-a994-46a4-8538-c70ed31728f9 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8405bb84-d32e-4a24-87d1-9e327dbc7236 HTTP/1.1" status: 204 len: 168 time: 0.1138165 Sep 16 16:48:40.276179 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2abcbb55-a994-46a4-8538-c70ed31728f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8405bb84-d32e-4a24-87d1-9e327dbc7236,revision_number=None']} {{(pid=93951) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 16 16:48:40.501627 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 265aca19-5d32-4586-afe0-25976e844af6 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:40.521832 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 265aca19-5d32-4586-afe0-25976e844af6 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:40.522169 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 265aca19-5d32-4586-afe0-25976e844af6 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:40.522587 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24b4a270-d20d-46a0-b8c2-12459c796e77 no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:40.544000 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: 24b4a270-d20d-46a0-b8c2-12459c796e77 {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:40.544341 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device 24b4a270-d20d-46a0-b8c2-12459c796e77 not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:40.544747 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d8b8287c-d4c4-4fd2-b75b-10350976edec no longer exists at agent ovs-agent-dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 16 16:48:40.564380 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.plugin [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] No Port match for: d8b8287c-d4c4-4fd2-b75b-10350976edec {{(pid=93952) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 16 16:48:40.564728 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron.plugins.ml2.rpc [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Device d8b8287c-d4c4-4fd2-b75b-10350976edec not bound to the agent host dv-cinder-805887-15-iscsi {{(pid=93952) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 16 16:48:46.084243 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:50.749658 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-884e464b-ad16-49ea-9da3-8ad9b56eb138 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:53.030789 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:48:53.470973 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-7ba6c5b6-c7d7-4561-972b-9c4817ef68b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:53.756524 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:54.491339 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:48:56.298302 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:16.074081 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:20.748727 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-2c546262-5a23-42ba-9607-c5657fad986b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:23.472594 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-1fd9ab91-8236-4b53-b57f-a7156e6fbc70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:23.757563 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:24.493963 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:26.303332 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:30.028845 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:49:37.992858 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b03c2875-663d-456e-8163-eceedc63dd23 req-6a7c8d69-faea-40f7-8a9d-1c822db32819 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0265231 Sep 16 16:49:38.054964 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b03c2875-663d-456e-8163-eceedc63dd23 req-eb4b72bb-a33b-4b1b-8a27-8c96f2650110 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0235715 Sep 16 16:49:38.091982 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b03c2875-663d-456e-8163-eceedc63dd23 req-45944040-4fcc-4682-baed-1dabb4bc95bd service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0184572 Sep 16 16:49:38.188395 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03c2875-663d-456e-8163-eceedc63dd23 req-8bd5d65e-b040-42f0-a3d5-0679b56a33c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:49:38.190044 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-b03c2875-663d-456e-8163-eceedc63dd23 req-8bd5d65e-b040-42f0-a3d5-0679b56a33c1 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0908530 Sep 16 16:49:46.084881 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:50.749291 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-89a3db10-8d81-4e87-8718-00d89a6f528c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:53.473281 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-41ea2474-0e16-4d77-bba4-59b3c39e1d40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:53.760627 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:54.497207 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:49:56.303837 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:07.028120 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:50:16.085887 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:20.748886 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c6aa57c2-dcff-45f3-871a-7a8fea57f001 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:23.473882 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d2b340ad-279e-4d81-b115-595b6a04975a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:23.762067 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:24.500241 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:26.307488 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:39.977081 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ab26a468-9277-4ffa-bfd0-1cbed2ba4d4a req-55b69aa6-a454-4d12-9f0d-78e6688c1d53 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0260801 Sep 16 16:50:40.040828 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ab26a468-9277-4ffa-bfd0-1cbed2ba4d4a req-8cd34a61-a7a4-4d09-b080-27a76f0c0f90 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0241117 Sep 16 16:50:40.078817 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ab26a468-9277-4ffa-bfd0-1cbed2ba4d4a req-c027054d-ddfe-45db-b928-651536c2efe9 service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0186436 Sep 16 16:50:40.170765 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab26a468-9277-4ffa-bfd0-1cbed2ba4d4a req-b5fb3687-5eaf-452a-8ae5-91158c87136e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:50:40.172213 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-ab26a468-9277-4ffa-bfd0-1cbed2ba4d4a req-b5fb3687-5eaf-452a-8ae5-91158c87136e service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0865040 Sep 16 16:50:44.026583 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:50:46.083917 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:50.748902 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-698bdfe6-9623-4309-9ef0-8c1753cf81db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:53.475007 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-99bee170-dc80-462d-af1c-2b303d002317 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:53.764743 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:54.506080 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:50:56.308374 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:16.109807 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:20.749185 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0d0eaf22-7e91-4d36-9edc-bfb747ebe48c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:21.024773 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:51:23.478242 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-20dbac9a-892a-41e9-b0ba-a091fcae299e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:23.764504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:24.506057 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:26.311504 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:39.974334 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-01b4549a-d440-4893-a934-b7cd333c3f5b req-7c6020d6-96fc-473c-99f9-403301bec9be service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0254941 Sep 16 16:51:40.036738 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-01b4549a-d440-4893-a934-b7cd333c3f5b req-c1b45758-f252-4222-96b4-dae06b928e27 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0245702 Sep 16 16:51:40.072605 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-01b4549a-d440-4893-a934-b7cd333c3f5b req-f209d7f6-3c01-4aaa-9140-cf25a43799df service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0181341 Sep 16 16:51:40.164286 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b4549a-d440-4893-a934-b7cd333c3f5b req-c4f45bf4-cb6d-47a9-b804-4fee363458ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:51:40.165811 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-01b4549a-d440-4893-a934-b7cd333c3f5b req-c4f45bf4-cb6d-47a9-b804-4fee363458ce service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0866487 Sep 16 16:51:46.108646 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:50.749302 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-0b6f68cb-97a4-45e1-a395-4bba4a86f2bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:53.478145 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-3996ad9d-d14f-4a97-ae88-bc19063b0d5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:53.766734 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:54.509499 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:56.314114 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:51:58.023277 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:52:16.122831 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:20.750449 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-b06d834d-9ef1-4367-aa62-3f4ae7468801 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:23.479466 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-402d68a7-ec63-4378-84aa-dda3b24455dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:23.766224 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:24.511791 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:26.328949 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:35.022293 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:52:40.087199 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aecdbad6-a51a-44cd-ab2d-db70bffdd56b req-f4647c5e-ee95-4b8d-bd6f-e96f6ff37ec2 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.1257439 Sep 16 16:52:40.153157 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aecdbad6-a51a-44cd-ab2d-db70bffdd56b req-feabdca1-4090-40f6-a609-f8dadc9a6065 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0241208 Sep 16 16:52:40.191240 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aecdbad6-a51a-44cd-ab2d-db70bffdd56b req-67b425a7-57c0-47fa-803a-4ce1ebf53e9e service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0188253 Sep 16 16:52:40.284194 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aecdbad6-a51a-44cd-ab2d-db70bffdd56b req-b02d2bf0-a956-4f69-ad50-1f3243055492 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:52:40.285548 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-aecdbad6-a51a-44cd-ab2d-db70bffdd56b req-b02d2bf0-a956-4f69-ad50-1f3243055492 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0881460 Sep 16 16:52:46.138082 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:50.750803 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-ac408d79-2c23-4581-aeaa-091333d17645 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:53.479650 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-c0039aa6-0cb3-41c4-91e5-5e02a15c64c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:53.765939 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:54.515997 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:52:56.319776 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:12.021284 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 16 16:53:16.158527 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:20.750414 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-16cc3e6c-d6af-41b5-84e6-bbb62f883dae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:23.480214 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d7a1d960-5c2b-481d-a742-0a007c48eb46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:23.765597 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-a51fcd9e-3d58-4ac1-b862-9f56953d47e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:24.518361 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-afe9ed15-4465-4767-b432-cba395608e40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:26.323685 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d28cdc9a-2ccf-41ed-8c9a-56be88bf5270 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:39.982690 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0989e421-2760-4a03-a71e-7d514ee7902c req-21f98d61-ac91-4d5a-8a8a-18064879f2a3 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0242493 Sep 16 16:53:40.046233 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0989e421-2760-4a03-a71e-7d514ee7902c req-f03083cf-77ba-4bea-bdc1-ddbe9f709da3 service neutron] 10.222.0.66 "GET /v2.0/ports?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&device_id=4ce1f5dd-2d0a-46fb-8c5f-671332f84f8d HTTP/1.1" status: 200 len: 210 time: 0.0240922 Sep 16 16:53:40.083203 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0989e421-2760-4a03-a71e-7d514ee7902c req-a1d2f139-1b26-4b9d-8aa0-9f6173193adf service neutron] 10.222.0.66 "GET /v2.0/networks?tenant_id=edfe8167ea8b4027bb39f6b5ad4d2c57&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0181193 Sep 16 16:53:40.175598 dv-cinder-805887-15-iscsi neutron-server[93951]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0989e421-2760-4a03-a71e-7d514ee7902c req-7d4690e8-8fc7-46cc-820a-66c521e4cf18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93951) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 16 16:53:40.176998 dv-cinder-805887-15-iscsi neutron-server[93951]: INFO neutron.wsgi [req-0989e421-2760-4a03-a71e-7d514ee7902c req-7d4690e8-8fc7-46cc-820a-66c521e4cf18 service neutron] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0878625 Sep 16 16:53:46.167624 dv-cinder-805887-15-iscsi neutron-server[93952]: DEBUG neutron_lib.callbacks.manager [None req-d150567e-f0ab-4ca5-9f33-9251c4bb5267 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8727675478155', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-767757'] for agent, after_update {{(pid=93952) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 16 16:53:49.020710 dv-cinder-805887-15-iscsi neutron-server[93953]: DEBUG neutron.db.agents_db [None req-1c03f387-81ac-45a9-8fc3-6d0ae160ff8f None None] Agent healthcheck: found 6 active agents {{(pid=93953) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}